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such  that  the  approximate  solution  converges  to  the  optimal  solution  ca 
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1.  INTRODUCTION 


l.l  Problem  Description 

This  thesis  treats  the  problem  of  finding  an  approximate  solution 
to  a  linear  class  of  optimally  controlled  singularly  perturbed  systems 

*1  =  fl(xl,x2,u,t,M,) 

(1.1) 

=  f2(xi*x2»u»t*^ 

where  x^,  x^,  and  u  are  n^- ,  n^-,  and  m- dimensional  vectors  respectively  aid 
pi  is  a  small  positive  parameter.  System  (1.1)  is  called  singularly  perturbed 
since  its  dimension  is  reduced  from  n^  +  02  to  n^  if  the  scalar  parameter  pi 
is  set  equal  to  zero.  Physically  this  parameter  may  represent  a  small  time 
constant,  mass,  moment  of  inertia  and  other  possibly  negligible  parameters.^ 
As  is  customary  in  engineering  design,  such  parameters  would  be  initially 
neglected  enabling  the  designer  to  solve  an  n^-th  dimensional  problem  instead 
of  the  original  (n^  +  n2)-th  dimensional  problem.  An  additional  advantage  of 
such  a  reduced-dimensional  design  is  the  avoidance  of  fast  transients  present 
in  the  high-dimensional  problem.  However,  the  best  a  reduced-dimensional 
design  can  do  in  general  is  to  approximate  the  optimal  solution  on  an  open 
subinterval  of  the  operation  interval  [tQ,T].  For  even  when  pi  is  very  small, 
large  discrepancies  between  the  optimal  and  the  reduced  solution  may  occur  at 

^For  example,  if  t  is  a  small  time  constant  and  m  is  a  small  mass, 
then  one  can  write  t  “  Ojii  and  m  “  a$i  where  and  are  appropriately 
chosen  coefficients. 
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the  ends  of  the  interval  because  some  of  the  boundary  conditions  were  dis¬ 
regarded  in  the  reduced  order  design.  The  end  intervals  in  which  these 
discrepancies  rapidly  diminish  are  called  boundary  layers  due  to  analogy  with 
fluids.  A  boundary  layer  method  is  developed  in  this  thesis  to  approximate 
the  optimal  solution  over  the  entire  interval  [t^jT].  The  method  is  straight 
forward  and  avoids  having  to  find  the  optimal  solution  which  is  often  diffi¬ 
cult  to  find  using  existing  numerical  methods.  The  difficulty  is  a  result  of 
both  widely  varying  decay  transients  and  widely  varying  growth  transients 
associated  with  the  solution  of  a  two  point  boundary  value  (TPBV)  problem. 

The  boundary  layer  method  developed  is  directly  applicable  to  two 
types  of  optimal  control  problems  for  the  system 


*1  =  A11(t,|i)x1  +  A12(t,n)x2 
\i>*  2  =  A21(t,ti)x1  +  A22(t,p,)x2 


(1.2) 


with  quadratic  performance  indices:  regulator  problems  and  trajectory 
optimization  problems. 

The  approach  taken  to  the  regulator  problem  in  this  thesis  is 
through  a  stabilizability  analysis  of  singularly  perturbed  systems.  The 
main  result  of  this  analysis  is  that  a  high -dimensional  system  is  stabilizable 
if  two  lower-dimensional  systems  are  stabilizable:  a  reduced  system  and  a 
boundary  layer  system.  The  optimal  regulator  problem  is  then  seen  as  the 
selection  of  the  best  of  the  stabilizing  controls.  The  existence  and  the 
singular  perturbation  properties  of  the  optimal  regulator  are  shown  by  a 
direct  method  not  involving  usual  optimality  conditions.  This  result 
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represents  further  extension  of  related  work  in  [41,55].^  However,  the 
methodology  used  here  is  different  from  either  of  these.  In  this  thesis, 
optimality  of  the  regulator  design  follows  immediately  from  properties  on 
the  reduced  solution. 

The  major  part  of  this  thesis  is  devoted  to  trajectory  optimiza¬ 
tion.  Both  fixed  end-point  and  terminal  cost  problems  are  treated  by  the 
same  method.  Boundary  layer  correction  terms  are  explicitly  obtained  for 
each  end  of  the  interval,  thus  revealing  the  two-time  scale  properties  of 
singularly  perturbed  optimal  trajectories.  From  a  control  designer's  point 
of  view,  a  useful  interpretation  of  the  fast  transients  in  the  boundary 
layers  is  that  they  can  be  viewed  as  the  results  of  two  boundary  layer 
regulators:  one  acting  in  forward  time  from  the  initial  point  and  the  other 
acting  in  reverse  time  from  the  end  point.  To  summarize,  the  approach  taken 
is  to  decompose  a  trajectory  optimization  problem  into  a  "slow"  trajectory 
optimization  problem  for  a  reduced  system  and  into  two  regulator  problems  for 
boundary  layer  systems.  The  solutions  of  these  problems  are  obtained  in 
separate  time  scales,  and  when  properly  combined,  they  form  an  approximation 

to  the  exact  solution  which  is  valid  uniformly  on  the  entire  interval  [t  ,t] . 

o 

It  should  be  pointed  out  that  the  singularly  perturbed  optimization 
problem  with  fixed  enc-points  has  not  previously  been  considered  from  a  control 
point  of  view,  although  techniques  for  the  solution  of  such  problems  are 
reported  in  [24,26].  The  problem  with  terminal  cost  is  treated  in  [33] 
where  the  approach  was  through  use  of  a  positive  definite  solution  of  a 

TThe  references  [21,40,41]  are  for  publication  in  the  near 


future  , 
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singularly  perturbed  Riccati  system.  The  approximation  obtained  by  this 
approach  was  not  valid  in  the  terminal  boundary  layer.  This  difficulty 
does  not  occur  in  the  method  developed  in  this  thesis  where  both  positive 
and  negative  definite  Riccati  solutions  are  employed  to  form  a  dichotomy 
transformation.  The  dichotomy  transformation  is  used  to  separate  the  TPBV 
problem  associated  with  the  trajectory  optimization  problem  into  two  inde¬ 
pendent  singularly  perturbed  initial  value  problems.  This  result  not  only 
simplifies  calculations  but  permits  the  treatment  of  a  singularly  perturbed 
TPBV  problem  by  the  more  common  treatments  used  for  Initial  value  problems. 

It  is  hoped  that  the  avoidance  of  TPBV  theory  [13,15,16,18]  will  help  control 
engineers  to  understand  and  apply  singular  perturbation  methods  in  system 
design.  In  the  same  spirit,  most  of  the  conditions  used  in  lemmas  and 
theorems  of  the  thesis  are  given  in  terms  of  notions  familiar  in  control 
theory  such  as  controllability,  observability,  stabilizability ,  etc.  It  is 
also  shown,  in  the  case  of  terminal  cost,  that  the  use  of  a  feedback  control 
whose  optimal  Riccati  gains  are  approximated  by  reduced  and  boundary  layer 
terms  will  result  in  an  approximate  solution  to  the  optimal  problem  which  is 
valid  uniformly  on  the  closed  interval  [tQ,T].  An  alternate  approach  to 
using  Riccati  equations  for  the  same  class  of  problems  is  the  use  of 
singularly  perturbed  TPBV  theory.  Such  an  approach  is  developed  in  a  yet 
unpublished  work  [40]  . 

In  the  method  of  this  thesis,  the  main  tool  is  a  transformation 
involving  two  solutions  of  a  singularly  perturbed  matrix  Riccati  system.  In 
general,  these  solutions  are  not  continuous  at  the  ends  of  the  Interval  due 
to  the  presence  of  the  boundary  layer  terms.  However,  the  transformation 
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needed  here  is  to  be  twice  continuously  differentiable  on  the  whole  interval. 
This  difficulty  can  be  avoided  if  the  boundary  conditions  of  the  singularly 
perturbed  Riccati  system  are  at  a  designer's  disposal.  In  this  thesis,  the 
end  conditions  for  the  Riccati  transformation  variables  are  free  and  are 
selected  to  guarantee  the  continuity  properties.  By  using  the  end  value  of 
the  reduced  solution  as  the  end  condition  for  the  singularly  perturbed  sys¬ 
tem,  the  zero  order  boundary  layer  is  eliminated  as  can  be  seen  from 
[21,39,53].  If  by  construction  this  boundary  condition  is  an  appropriate 
function  of  |x ,  boundary  layers  can  be  eliminated  to  any  desired  order. 

1.2  Singular  Perturbation  Results  in  Control  Theory 

The  first  major  analysis  [28,45,46]  of  singularly  perturbed  optimal 
control  problems  dealt  with  finding  an  approximate  solution  to  the  optimal 
control  problem  on  the  open  interval  (t^.T).  Thus,  only  "outer"  expansions 
were  considered.  The  analysis  avoided  a  direct  study  of  the  singularly 
perturbed  TPBV  equations  by  using  two  different  approaches,  each  of  which 
resulted  in  the  need  to  analyze  only  singularly  perturbed  initial  value 
problems.  The  first  approach  was  to  assume  that  the  control  and  its  deriva¬ 
tive  were  continuous  in  t  and  for  t  e  [t^.T]  and  11  e  [0,n*].  The  approach 
suffered  from  not  being  able  to  define  a  reasonable  class  of  problems  for 
which  this  assumption  is  valid,  yet  did  provide  a  correct  outer  expansion. 

The  second  approach  was  for  a  linear-quadratic  free  end-point  problem  where 
the  feedback  control  was  expressed  in  terms  of  Riccati  gains.  The  approach 
was  successful  but  was  applied  under  the  following  three  restrictions;  the 
system  is  time  invariant,  the  fast  variable  x^  is  not  in  the  performance 
index,  and  ^22  Is  negative  definite. 
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The  Riccati  approach  was  extensively  developed  in  [29,55].  Time 

varying  systems  were  permitted,  the  fast  variable  could  appear  in  the 

performance  index,  and  the  requirement  that  k^  be  negative  definite  was 

relaxed  by  requiring  only  boundary  layer  controllability  and  boundary  layer 

observability--notions  introduced  there.  Both  "inner"  and  "outer"  expansion 

terms  were  treated  making  it  possible  to  approximate  the  Riccati  solution 

on  the  closed  interval  [t  ,t] .  The  singularly  perturbed  initial  value 

o 

problem  resulting  upon  insertion  of  the  feedback  control  containing  Riccati 
gains  with  boundary  layer  jumps  at  t  ■  T  into  the  system  equations  was 
successfully  analyzed  but  only  for  a  subinterval  of  [tQ,T).  The  problem  of 
an  end-point  jump  was  avoided  when  various  sub-optimal  feedback  designs  were 
proposed  and  analyzed  by  not  permitting  boundary  layer  jumps  to  occur  in  the 
gain  matrices.  In  this  thesis,  the  results  of  [55]  are  extended  by  showing 
that  the  use  of  two  Riccati  systems  can  avoid  the  difficulty  of  having  to 
analyze  a  system  with  boundary  layer  jumps  at  both  ends.  Thus  an  approxima¬ 
tion  to  the  optimal  solution  is  given  which  is  valid  on  the  closed  interval 
[tQ,T].  Furthermore,  the  two  Riccati  approach  permits  an  analysis  of  a 
trajectory  optimization  problem;  a  problem  which  could  not  be  treated  by  the 
approach  in  [55]. 

Singularly  perturbed  optimal  control  applications  in  flight  problems 
are  reported  in  [24,25,26].  In  [26],  a  heuristic  approach  is  given  for  con¬ 
struction  of  an  approximate  solution  to  a  non-linear  optimal  control  problem 
which  accounts  for  boundary  layer  jumps  at  both  ends  of  a  fixed  time  interval. 
The  approach  is  in  agreement  with  the  expansion  in  [50]. 

A  complete  expansion  for  the  state  variables,  control  and  per¬ 
formance  index  is  given  in  [40]  for  the  same  linear-quadratic  optimization 
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problem  considered  in  [55].  Each  term  of  the  state  and  control  variables 
contained  a  left  and  right  inner  term  in  addition  to  an  outer  term.  The 
validity  of  the  asymptotic  correctness  of  the  method  was  based  on  [5l]. 

The  expansion  would  be  similar  to  that  of  [50]  for  such  a  problem.  Thus  the 
approximation  was  shown  to  be  valid  for  the  closed  interval  [to>T].  The 
hypotheses  were  not  control  oriented,  and  the  treatment  given  assumed  that 
the  eigenvalues  of 


!  A22 

S22 

L  Q22 

-A22 

have  multiplicity  one,  an  assumption  not  made  in  this  thesis.  In  [4l],  the 
Riccaci  method  was  used  to  solve  a  time  invariant  regulator  problem  for  a  scalar 
system,  A  formal  expansion  of  the  algebraic  Riccati  gains  was  made  about  the 
origin  and  shown  to  be  convergent  there  and  without  boundary  layers.  This 
paper  assumed  conditions  on  the  high-dimensional  system  in  contrast  to  that 
used  in  this  thesis  where  assumptions  on  only  the  low- dimensional  auxiliary 
systems  are  made.  Since  no  boundary  layers  appear  in  the  system  equations 
when  the  optimal  feedback  control  is  inserted  into  them,  a  standard  singularly 
perturbed  Initial  value  problem  results  to  which  expansions  are  well  known 
and  valid  for  t  e  [t^.T). 


1.3  Stability  Problems 


There  are  two  types  of  results  for  the  high-dimensional  infinite 
time  initial  value  problem.  The  first  result  guarantees  that  the  solution 
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converges  uniformly  in  t  to  the  reduced  solution  on  any  interval  of  the  form 
[t',“)  where  t  <  t'.  The  second  result  guarantees  that  a  solution  of  the 
high -dimensional  problem  is  asymptotically  (or  conditionally  asymptotically) 
stable.  The  first  result  is  used  to  approximate  the  solution  of  the  high¬ 
dimensional  problem  by  that  of  the  low-dimensional  reduced  problem.  A 
crucial  hypothesis  often  assumed  in  proving  similar  approximation  results  on 
a  finite  time  interval  is  that  the  real  part  of  all  the  eigenvalues  of  the 

df2 

matrix  - —  evaluated  along  the  reduced  trajectory  is  less  than  a  fixed 
z  + 

negative  number.  An  additional  hypothesis  is  generally  assumed  for  the 
infinite  time  problem.  This  hypothesis  is  the  uniform  asymptotic  (or  con¬ 
ditional  asymptotic)  stability  in  the  small  of  the  reduced  solution.  Since 
both  of  the  hypotheses  stated  are  for  linearized  systems,  the  results  obtained 
based  on  these  hypotheses  are  only  valid  for  initial  conditions  rtarting  near 
the  reduced  solution.  Such  hypotheses  were  made  in  [5,27]  with  the  exception 

af2 

that  in  [27]  the  eigenvalue-criteria  of  t —  was  replaced  by  Krasovskii's 

ox^ 

condition  [ 14] .  Both  of  these  hypotheses  were  relaxed  in  [18,20].  Different 
techniques  were  used  to  establish  these  results:  asymptotic  [2l], 

Lyapunov  [18,20,27],  and  successive  approximation  [5],  Conditionally  stable 
systems  were  treated  only  in  [5,2l].  The  approximation  and  stability 
results  of  [27]  were  extended  in  [ 18]  and  [20]  respectively  to  treat  a  much 
wider  class  of  problems,  and  [18]  permitted  f^  and  f^  to  depend  on  ix  which 
was  not  permitted  in  [20,27].  Both  of  the  conditionally  stable  works  [5,2l] 
permitted  f^  and  f^  to  depend  on  |x . 

*A  matrix  in  which  the  real  part  of  all  its  eigenvalues  is  less 
than  a  fixed  negative  number  is  called  stable. 
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1.4  Two  Point  Boundary  Value  Problems 

The  crucial  hypothesis  used  in  all  the  singularly  perturbed  TPBV 
theorems  surveyed  here  is  that  the  absolute  value  of  the  real  part  of  all 

af2 

the  eigenvalues  of  the  matrix  - —  evaluated  along  the  reduced  trajectory  is 

OX2 

greater  than  a  fixed  positive  number.  The  basic  method  for  analysis  of  such 
problems  was  first  made  evident  in  [31}  for  an  Initial  value  singularly 
perturbed  system.  The  method  consisted  of  finding  an  initial  stable  manifold 
such  that  solutions  starting  on  this  manifold  would  rapidly  converge  and  then 
remain  close  to  the  reduced  solution.  For  finite  time  problems,  it  was  also 
shown  there  that  solutions  starting  slightly  off  this  initial  stable  manifold 
could  also  be  made  to  remain  close  to  the  reduced  solution  by  making  p, 
sufficiently  small.  The  singularly  perturbed  TPBV  theory  is  based  upon 
recognizing  that  a  terminal  stable  manifold  exists  similar  to  that  of  the 
initial  stable  manifold.  Solutions  starting  on  the  terminal  manifold  also 
rapidly  converge  and  then  remain  close  to  the  reduced  solution,  but  in 
reverse  tune.  Thus  the  manifolds  exist  as  a  consequence  of  the  crucial 
hypothesis  stated. 

For  the  boundary  conditions  to  be  on  such  manifolds  at  each  end  of 
the  time  interval,  it  is  necessary  that  there  exists  a  particular  association 
of  eigenvalues  with  the  state  variables.  Assuming  the  eigenvalues  are  con¬ 
tinuous,  knowledge  that  the  eigenvalues  at  any  time  1  are  associated  with  the 


correct  states  implies  the  correct  association  with  the  states  for  all  time. 


To  guarantee  the  proper  association,  an  additional  hypothesis  is  needed. 

For  this  purpose  a  transformation  hypothesis  was  given  in  [15,163  and  still 
another  type  was  given  In  [13]. 
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A  linear  system  was  analyzed  in  [15,16]  for  the  most  general 
combination  of  boundary  values  at  t  =  t  and  t  =  T.  The  hypotheses  given 
were  very  difficult  to  check  and  the  results  valid  only  on  an 
open  sub interval  of  [t^.Tl.  Non-linear  systems  were  analyzed  in 
[l3t21,50].  The  problem  treated  in  [ 13]  assumed  the  system  was  composed  of 
two  slow  systems  y^,  y^  and  two  fast  systems  satisfying  boundary  con¬ 

ditions  on  y^  and  (u^  at  t  =  tQ  and  y ^  and  at  t  *  T.  The  treatment  adapted 
the  approach  in  [3l]  and  proved  the  closeness  of  the  reduced  solution  to  the 
high-dimensional  solution  providing  the  boundary  condition  on  at  t  *  tQ 
and  on  oj^  at  t  =  T  were  close  to  the  reduced  solution.  The  most  general 
theorem  available  thus  far  is  stated  in  [2l] .  If  y  is  the  fast  system  and  » 
the  slow  system,  the  boundary  conditions  at  t  :s  tQ  were  given  there  by 

tf(y(t0),<U(to)4i)  -  0,  £(y(T),u>(T),n)  =  0 

where  Gt  and  B  are  smooth  functions  of  their  arguments.  The  theorem  guarantees 
the  closeness  behavior  providing  the  boundary  value  at  t  *  tQ  was  on  the 
intersection  of  Q  and  an  initial  stable  manifold  and  at  t  ■  T  was  on  the 
intersection  of  B  and  a  terminal  stable  manifold.  In  [50],  a  method  is  given 
for  finding  an  asymptotic  expansion  for  a  system  in  which  the  fast  variable 
boundary  conditions  are  given  on  the  variables  either  at  t  ■  t  or  at  t  ■  T. 
The  slow  variable  boundary  conditions  were  arbitrary. 

1-5  Chapter  Preview 

Chapter  2  develops  a  methodology  for  proving  the  existence  of  an 
optimal  solution  to  a  regulator  problem  which  should  be  generally  applicable 
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to  broadening  the  class  of  linear  systems  with  quadratic  performance  indices 
known  to  have  an  optimal  solution.  It  is  shown  that  the  existence  of 
stabilizing  controls  for  two  low-dimensional  systems  not  only  implies  the 
existence  of  a  stabilizing  control  for  the  high -dimensional  system  but  also 
that  an  optimal  solution  exists  to  the  regulator  problem. 

Chapter  3  is  a  preparatory  chapter  for  the  remaining  chapters  where 
a  dichotomy  transformation  is  introduced  and  a  comparison  is  made  between 
a  non-s ingularly  perturbed  system  and  a  singularly  perturbed  system.  Condi¬ 
tions  are  imposed  so  that  both  systems  behave  similarly  to  point  out  the 
interchanging  roles  of  the  operation  Interval  in  the  first  case  and  ix  in 
the  second. 

Chapter  4  contains  the  main  results  of  the  thesis  where  a  method  is 
given  to  approximate  the  optimal  solution  of  a  fixed  end-point  problem  whose 
exact  solution  would  in  general  be  difficult  to  solve.  An  application  of  the 
method  is  given  for  an  example  problem  in  Chapter  5. 

The  example  problem  of  Chapter  5  graphically  illustrates  the 
important  points:  two-time  scale  property,  boundary  layers  at  both  ends  of 
tt>-  time  interval,  closeness  of  the  approximate  solution  to  the  actual 
optimal,  sti'f'ess,  and  how  the  interval  in  which  the  reduced  solution  may  be 
a  good  approximation  can  be  extended  by  decreasing  ix . 

Chapter  6  applies  the  method  to  a  free  end-point  problem  and  also 
includes  an  example  problem.  Furthermore,  it  is  shown  that  the  optimal 
solution  is  approximated  uniformly  on  the  interval  [t^.T]  when  an  approximate 
feedback  structure  is  used  consisting  of  Riccati  gains  approximated  by  their 
reduced  and  boundary  layer  terms. 


2.  REGULATOR  PROBLEM 


2.1  Problem  Statement  and  Approach 

This  chapter  considers  the  design  of  a  feedback  control  to  regulate 
the  singularly  perturbed  system 


*1  =  f1(x1,x2,u,t,n) 
p.x2  =  f2(x1,x2,u,t^i) 


(2.1) 


for  which 


f^O.O.O.t.n)  =  0, 


f2(0,0,0,t^)  -  0 


(2.2) 


for  all  t  ^  tQ,  p,e(0,ji  J.  Here  x^  x2 ,  and  u  are  n^-,  n2~,  and  m-dimen- 
sional  vectors  respectively,  and  ^  is  a  small  positive  scalar  parameter. 

The  zero  solution  of  (2.1)  might  represent  any  nominal  trajectory  of  a 
system  having  the  form  (2.1)  but  which  has  been  translated  into  the  origin 
in  a  new  coordinate  system.  In  this  translated  coordinate  system,  (2.1) 
describes  the  motion  about  the  original  from  a  perturbed  initial  condition. 

Thus  one  could  consider  the  problem  of  regulation  for  the  translated 
system  as  that  of  finding  the  control  to  make  a  desired  trajectory 
asymptotically  stable.  Restricting  the  clcss  of  non-linear  problems  to 
those  in  which  the  behavior  of  the  linearized  system  determines  the  behavior 
of  the  non-linear  system  such  as  [27,52],  only  the  linearized  system  of  (2.1) 
needs  to.be  analyzed.  A  stabilizing  control  is  defined  here  as  one  which  makes 
the  zero  solution  of  (2.1)  asymptotically  stable.  If  such  a  control  is 
applied  to  the  system,  the  system  is  then  said  to  be  stabilized.  The  first 
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result  of  this  chapter  is  to  show  in  section  2.2  that  the  existence  of 
stabilizing  controls  for  two  lower-dimensional  systems  guarantees  the 
existence  of  a  stabilizing  control  for  the  higher-dimensional  system  (2.1). 

This  theorem  is  applied  in  section  2.3  to  a  time  invariant  system 
to  justify  the  regulator  design  proposed  in  [55].  In  general  many 
stabilizing  controls  can  be  found  for  a  stabilizable  system.  Of  interest 
is  the  selection  of  one  of  these  which  can  easily  be  found,  implemented, 
and  which  yields  a  performance  cost  close  to  the  optimal  cost.  A  perfor¬ 
mance  index  will  be  given  for  the  same  system  which  was  shown  to  possess 
a  stabilizing  control.  The  second  result  of  this  chapter  is  to  show  that 
the  existence  of  stabilizing  controls  for  the  two  low-dimensional  systems 
not  only  implies  the  existence  of  a  stabilizing  control  for  the  high¬ 
dimensional  system  but  also  that  an  optimal  solution  exists  to  this 
regulator  problem.  Lastly  it  will  be  shown  that  the  proposed  design  is  a 
good  approximation  to  the  optimal  design. 

2.2  Stabilizing  Controls 

Since  the  existence  of  stabilizing  controls  follows  from  a  stability 
theorem,  this  theorem  will  be  given  first.  Few  stability  results  exist 
for  singularly  perturbed  systems,  and  the  two  main  results,  of  which  one  is 
given  by  Klimushev  and  Krasovskil  [27]  and  the  other  by  Hoppensteadt  [20], 
are  not  well  known.  This  is  evidenced  by  the  recent  articles  [10, 11,47] 
for  linear  time -invariant  systems  of  form  (2.1)  applied  to  networks  with 
small  and  large  parasitics.  The  stability  theorems  of  [10,11,47]  are 
encompassed  by  the  earlier  work  done  by  Klimushev  and  Krasovskli.  Hoppensteadt' s 
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hypotheses  are  numerous  and  not  well  suited  from  an  engine*  ring  standpoint  even 
though  he  treats  a  more  general  problem  than  that  covered  in  [20].  Neither  of 
these  stability  works  considers  the  case  when  f^  and  f^  depend  on  px.  Such  a 
result  appears  in  [5]  whose  proof  is  based  on  successive  approximations.  A 
stability  theorem  for. a  linear  system  whose  matrices  depend  on  p,  will  be 
given  which  is  an  extension  of  the  theorem  in  [27]  whose  proof  is  based  on 
Lyapanov  functions. 

The  following  theorem  deals  with  the  uniform  asymptotic  stability 
of  the  linear  system 


*1  *  All.<t,M,)Xl  +  Ai2(t>>A)x2 
p.x2  *  A21(t,M-)x1  +  A22(t,n)x2 


(2.3) 


The  stability  property  of  (2.3)  for  p  sufficiently  small  is  deduced  from 
stability  properties  of  two  auxiliary  systems:  the  n2-dimensional  system 


I 

I 

I 

T 


q-A22(9,0)q  (2.4) 

where  0  *  t  is  a  fixed  parameter,  and  the  n^-dimensional  system 

p  -  [Au(t,0)  -  Al2(t,0)A22'1(t,0)A2l(t,0)]p.  (2.5) 

Theorem  2,2.1  If 

(i)  all  the  matrices  A^t.p)  in  (2.3)  and  their  derivatives  with 
respect  to  t  and  pi  are  bounded  and  continuous  for  all  t  i  tQ, 

p«[0,p*]  , 


I 

I 

I 

I 

I 

I 

I 
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(II)  the  real  parts  of  all  the  eigenvalues  of  A22(9»0)  are  smaller 
than  a  fixed  negative  number  for  all  0  i  t^, 

(III)  system  (2.5)  Is  uniformly  asymptotically  stable, 

then  there  exists  a  /  >0  such  that  system  (2.3)  Is  uniformly  asymptotically 
stable  for  all  n*  (0,^*3. 

Proof:  Define  6x  and  6y  using 

x^  *  x^  +  5x 

.1  (2.6) 

*2  "  *1  +  -  A22  A216x 

where  (x^,x2)  and  (x^,x2)  are  solutions  of  (2.3)  corresponding  to  two 
different  Initial  conditions.  For  brevity,  arguments  of  functions  are 
dropped  when  no  confusion  results,  and  a  bar  is  used  to  Indicate  that  p,  ■  0. 
Thus  denotes  Aj^(t,n)  and  A^  denotes  A^^(t,0).  Upon  substitution  of 
(2.6)  into  (2.3), 


6x  *  (F  +  AA^  -  AAj^S)6x  +  A126y 


AA21  AA22  -  - 

(j.6y  «  ( — —  -  S  +  S  +  SR  +  S  AAU  -  S  AA12S)6x 


(2.7) 


A22  ,  AA22 


+  ( -  +  — —  +  SA.,)6y 

p.  p.  12'  J 


where  R  m  A^^  ~  ^^2A22  A21*  ^  **  A22  A21^  a^d  AA1J  *  ~  Aij* 

Clearly,  when  (2.7)  is  uniformly  asymptotically  stable  for  pi  >  0  so  is 

(2.3).  Let  M(0 ,0)  be  the  unique  positive  definite  solution  of 
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I 

1 

i 

mi  | 

A^2(8,0)M  +  MA22(6,0)  -  -  1  (2.8)  \ 

•  * 

for  all  6  ^  t  .  Here  and  in  (2.11)  1^  denotes  a  k  x  k  identity  matrix. 

From  (ii)  it  follows  that  q'M(0,O)q  is  a  Lyapunov  function  for  (2.4). 

Let  the  function  p'Np,  whose  derivative  for  (2.5)  is  -p'p,  be  a  Lyapunov 
function  guaranteeing  (iii).  This  function  exists  by  a  well  known 
Lyapunov  theorem,  such  as  Theorem  3  of  [23], 

It  is  now  shown  that,  for  a  sufficiently  small  positive  p, ,  the 

function 


w  *  6x*N6x  +  6y'M6y  (2.9) 

is  a  Lyapunov  function  for  (2.7)  satisfying  the  requirements  for  uniform 
asymptotic  stability  such  as  the  conditions  of  Theorem  1  of  [23],  By 
definition  of  M  *  M(t,0)  and  N  there  exist  continuous  nondecreasing  functions 
a  and  0  of  the  norm  j|fix,6yj|  such  that  ar(0)  ■  0,  8(0)  *  0  and 

0  <  a(!|6x,6y||)  *  w  *  0(||6x,6yl|)  (2.10) 


holds  for  all  t  ^  t  and  all  6x  f  0,  6y  f  0.  The  derivative  of  w  for  (2.7) 
is 


6x 

l  _ 

-  6y  . 

-I  +  L.. 
n^  11 


L12 


-  -  I  +  L- 
w  n2  2 


6x  ‘ 

_  - 

(2.11) 


where 
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Lt1  =  N(AAn  -  AA12S)  +  (AA„  -  AA,?S)'N 


11  12fc 


12  +  [i^A21  '  ^A225  +  *  +  S(*  +  “U  -  4AU§>]'fi 


L,„  *  NA 


*  Aao2  i  _  ^A»2  _ 

l22  =  M  +  (— —  +  SA12)  M  +  +  SA12) . 


“n,  , 

The  - ■!  are  bounded  functions  for  t  ^  t  and  for  all  (j.6[0,m.  ]  by  (i). 

M>  o 

After  substitution  of  8  by  t  in  (2.8)  and  differentiation  with  respect  to 
t,  it  follows  that 


“  A22CT  -  _  1  A22t7 
e  (A22M  +  MA22)e  dJ 


(2.12) 


Hence  from  (2.12)  and  hypothesis  (i),  the  are  bounded  for  all  t  *  tQ  and 

for  all  neCo^i*];  moreover  -•  0  as  p,  -»  0.  Thus  is  dominated  by  -  1^ 

1  1 

for  sufficiently  small  p .  Also  L_»  is  dominated  by - I  for  p  sufficiently 

small.  Inspection  ot  leading  principal  minors  of  the  symmetric  matrix  in 
(2.11)  shows  that  there  exists  a  positive  p  such  that  for  all  Pe(0,p  J, 
all  t  2  t  and  all  fix  f  0,  6y  f  0 


w  t  -Y(l!$x,6y|j)  <  0 


(2.13) 


where  y  is  a  nondecreasing  function  and  y(0)  “  0.  Properties  (2.10)  and 
(2.13)  of  w  and  w  prove  that  (2.7)  is  a  uniformly  asymptotically  stable 
system  for  pe(0,p  J. 

The  purpose  for  including  the  fix  term  in  transformation  (2.6)  was 
to  avoid  the  appearance  of  ~A^j  terms  in  the  off-diagonal  terms  of  the 
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coefficient  matrix  in  (2.11).  The  smoothness  assumptions  made  in  (i)  could 
have  been  relaxed  as  is  evident  from  the  requirements  that  the  coefficient 
matrix  in  (2.11)  be  positive  definite.  It  is  further  noted  that  if  one  were 
to  search  for  the  least  upper  bound  of  y,  which  makes  the  i-th  leading  principal 
minor  positive  but  which  is  not  to  exceed  that  found  for  the  (i-l)-th  minor, 
then  by  repeating  this  process  through  i  =  n^  +  n^  a  y,  is  obtainable. 

The  stabilization  theorem  will  now  be  given  for  the  system 


*1  =  An  +  Al2(t,^i)x2  +  B1(t,y,)u 

=  A21(t,n)xL  +  A22(t,y,)x2  +  B2(t,yi)u 


(2.14) 


The  theorem  is  based  on  the  existence  of  two  controls:  u2  =  D2(8,0)q  to  malte 
the  system 


jjf  =  A22(0,O)q  +  B2(6,0)u2 


(2.15) 


asymptotically  stable  for  all  8  2  tQ  and 


Dp  to  make  the  system 


dt 


{Au-(Ai2+BiD2)  (A22+B2D2)_1A21}p 

+  { v  (A12+B152)  (a22+b2d2)  ■  lB2}  ux 


(2.16) 


uniformly  asymptotically  stable.  It  will  be  shown  that  when  and  u2  do 
exist,  then  the  control 


"  D1(t,^)x1  +  D2(t,yOx2 


u 


(2.17) 
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stabilizes  (2.14).  To  formulate  the  corollary  it  is  convenient  to  first 
express  u  in  (2.14)  in  terms  of  0^  and  D^.  Hence 

(2.18) 


(2.19) 

Corollary  2,2.2  If  there  exist  and  such  that  the  satisfy  the 
hypotheses  of  Theorem  2.2.1  where  the  C„  replace  the  matrices,  then  there 
exists  a  /  >  0  such  that  the  control  (2.17)  makes  system  (2.14)  uniformly 
asymptotically  stable  for  all  p,e<0,p,*j. 

Tbfc  proof  is  obvious  in  view  of  Theorem  2.2.1. 

23  A  Regulator  Design 

As  an  application  of  the  stability  theorem  2.2.1,  it  is  now  investi¬ 
gated  whether  the  control  proposed  in  [551,  for  a  time  invariant  system  of  the 
form  (?  1M,  is  a  stabilizing  control  for  all  ne(0,p,*].  The  proposed  control 
was  to  not  only  stabilize  the  system  but  yield  a  low  cost  for  the  performance 
index 


dt 


(2.20) 
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Since  optimality  is  meaningless  unless  it  can  be  shown  that  the  system  can  be 
stabilized,  the  latter  is  analyzed  first.  The  control  proposed  in  [55]  is 
given  by 


u  =  -R 


-1 


B2 

B'  A 
1  u 


11 

“*12 

12 

“*22 

With  (2.21),  system  (2.14)  becomes 


'  V 

A1 1 ”S 1 1^1 l”S 12^12 

A12'M,S11*12"S12^22 

M.x2 

_A2l'Sl2^1l"S22^12 

A22'v,Si2^12'S22^22_ 

Lx2. 


(2.21) 


(2.22) 


where  =  B^R  =  B^R  ^B^,,  S22  =  B2R  ^B^.  From  the  stability  theorem 

it  is  evident  that  (2.21)  is  a  stabilizing  control  if  the  following  two 
matrices  are  stable: 


"S22K22 


(2.23) 


-l/i 


{AirSllKll'S12K12)‘(A12-S12K22^  ^A22"S22K22^  ^A21_S12Kll"S22Kl2^  (2*24) 


This  is  indeed  the  case  for  the  proposed  control  as  a  result  of  the  hypotheses 
given  in  [55]  and  of  the  selection  of  the  K^'s  as  the  unique  root  for  ^  *  0 
of  the  algebraic  Riccati  system 
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0  -  “Kn  rAi  i“S12K12)  ~  (All“S12K12'>  K11 

"  K12A21  ‘  A21K12+K11S11K11+K1^22K12  “  Q11 
0  =  -K12<A22‘S22K22)  ~  K11A12+K1 1S12K22  "  A21K22  '  ^12  (2.25) 

•  M-(AiiKi2~KilSiiKi2~K12S12K12^ 

0  =  "K22A22  *  A22K22+K22S22K22  "  Q22 

viLKl2(A1?-S12K22)+(A12-S12K22)  K12  -  W‘K12S1iKi2^ 


having  the  property  that  K(1  and  K22  are  symmetrical  positive  definite  matrices. 
Thus  K22  Is  the  symmetrical  positive  definite  root  of 

K22in+i„K„-K22S22K22^22  -  0.  (2.26) 

Kjj  is  the  symmetrical  positive  definite  root  of 


KA  +  A  K  -  KSR'lk+  Q  =  0, 


and 


wb-  re 


K12  =  KnEi  *  E2 


A  =  Au+E1A?l  +  S12E?  +  ^  jS  ^  jE2  , 


B  =  +  E}B2 


Q  =  F?A2l  A?lF2-E?S?2F2+01 j 


E1  '  'Si 2K2?  Al?) IA22  S?2K22) 


-1 


L2  =  <*2|K??+Q1?) *A?2  S22K22) 


-1 


(2.27) 

(2.28) 
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The  hypotheses  which  have  been  assumed  in  [55]  are 

(i)  The  coefficient  matrices  of  the  time  invariant  plaut  (2.14),  Q,  R 
and  their  derivatives  are  bounded  and  continuous  functions  of  jjl 
for  all  neLO,^  ] » 

(ii)  For  all  y,e[0,n*],  the  symmetrical  matrix  Q  is  positive  semi- 
definite  and  R  is  positive  definite, 

(iii)  The  pair  is  controllable  and  the  pair  (^22>C2)  *-8 

observable  where  C!,C2  =  Q22> 

(iv)  The  pair  (A,B)  is  controllable  and  the  pair  (A,C)  is  observable 
where  C'fi  =  Q. 

Hypothesis  (iii)  guarantees  the  (2.23)  is  a  stable  matrix  and  hypothesis  (iv) 
guarantees  that  (2.24)  is  a  stable  matrix. 

2.4  Optimal  Regulator  Design 

Now  that  it  has  been  established  that  the  system  can  be  stabilized, 
it  will  be  shown  that  an  optimal  solution  exists  for  the  problem.  This  is 
done  by  two  lemmas.  The  first  verifies  the  existence  of  a  unique  symmetrical 
positive  definite  root  of  (2.25)  in  the  neighborhood  of  |x  =  0.  The  second 
justifies  the  optimality  of  this  root.  It  will  then  be  shown  that  the 
proposed  design  is  near  optimal  for  sufficiently  small  pi. 

Lemma  2.4,1  There  exists  a  p,  such  that  for  all  pie(0,|i,  ], 


K 


11 


12 


|_p.*42  M.K22  J 


(2.29) 
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is  the  unique  symmetrical  positive  definite  root  of  (2.25)  and  that 


A  A 

A11  A12 


A21  A22 


(2.30) 


is  a  stable  matrix. 

Proof ;  It  follows  from  an  application  [48]  of  the  implicit  function 
theorem  that  for  |i  small  there  exist  unique  positive  definite  and  K.^2 
satisfying  (2.25)  and  that  +  0 (|i)  . 

Inspection  of  the  leading  principal  minors  of  (2.29)  shows  that  there  exists 
a  y.*  such  that  for  all  ne(0,y.*],  this  matrix  (2.29)  is  positive  definite. 

That  (2.30)  is  a  stable  matrix  now  follows  upon  application  of  Theorem  2.2.1 
and  the  fact  that  +  0(y,). 

Lemma  2,4.2  If  there  exists  a  unique  symmetrical  positive  semi-definite 
root  P  to  the  algebraic  Ric^ati  equation 


A!K  +  KA  -  KSK  +  Q 


(2.31) 


and  if  the  control  u  * 


-R  ^B'P^x  makes  the  time  invariant  system 


x  =  Ax  +  Bu 


(2.32) 


asymptotically  stable,  then  this  control  minimizes  the  performance  index 
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J  =  f  (x'Qx  +  u*Ru)dt  .  (2.33) 

Co 

The  minimum  value  of  the  performance  index  where  R  is  positive  definite  is 
given  by  x'  (to)P0Bx(to)  . 

Proof :  Let  y^u  +  R  ^B'P^x.  Then  (2.32)  and  (2.33)  become 

x  =  (A  -  SPJx  +  By  (2.34) 

J  -  J  Lx 1  Qx  +  (y  -  R-1B'Podx),R(y  -  R-1B,Poox)]dt  (2.35) 

t 

o 

-  f° [y'Ry  +  x'(Q  +  P^SPJx  -  2y,B'Peox]dt 
t 

o 

and  recognizing  the  fact  that  P^  is  a  solution  of  (2.27),  it  follows  that 


J  =  f  (y'Ry  -  2[(A-SPoo)x  +  By]*  P^x)  dt 

t' 

o 


00  00 
=  j*  y'Rydt  -  2  J'  x'P^xdt 


00 

■  J  y'Rydt  +  x'(tQ)Pa)x(to) 


(2.36) 


Thus  the  minimizing  control  is  given  for  y  =  0  since  R  is  positive  definite, 
and  P^  is  positive  semi-definite.  This  proof  is  based  on  C2] . 

Theorem  2,4.3  For  all  n«(0,4*],  there  exists  a  unique  positive  definite 
root  of  (2.25)  such  that  the  feedback  control 
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u  =  -R 


Bi 


B2 


K 

UK! 


11 

^K12 

1 

12 

“*22 

(2.37) 


minimizes  (2 . 33) . 

Proof :  This  immediately  follows  from  Lemma  2.4.1  and  Lemma  2.4.2  defining 


"All 

A12 

"Bl" 

A  = 

A21 

A22 

,  B  = 

®2 

_ 

ft  _ 

-  H  . 

'=u 

!u 

m. 

9 

it 

O' 

i—i 

O' 

1 _ 

C - 

cs 

p— < 

O' 

!k 

L  p, 

S22 

2- 

-Qi2 

Q22_ 

for  use  of  Lemma  2.4,2. 

The  performance  index  is  defined  for  4e[0,|j,*]  and  hence  J  -*  J  as 
H  -  0  and  is  represented  by  J  =  j  +  0(h). ^  Thus  the  proposed  design  gives  a 
performance  cost  close  to  that  resulting  from  the  optimal  control.  An  alternate 
control  having  the  same  general  properties  as  (2.21)  is  given  by 


u 


-R_1[B{  B^] 


(2.38) 


q(t)  - 
the  inequality  |q 


0(n)  if  the  norm  |q(t)|  of  the  vector  or  matrix  q  satisfies 
|  £  au  for  some  positive  scalar  constant  or  and  for  h  £  h  . 
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3.  A  DICHOTOMY  IN  LINEAR  CONTROL  THEORY 

3.1  Introduction  and  Statement  of  Problem 

This  chapter  introduces  a  dichotomy  transformation  which  serves  as 
a  tool  in  solving  TFBV  singular  perturbation  problems.  Also,  a  comparison 
is  made  between  a  singularly  perturbed  problem  and  a  nonsingular ly  per¬ 
turbed  problem  in  which  similarities  are  pointed  out. 

A  2n-diroens ional  system 


A(t) 


-S(t)‘ 


L-Q(t)  -A'(t). 


(3.1) 


is  said  to  possess  an  "exponential  dichotomy"  if  there  exist  positive 
constants  a,  g,  y  and  §  such  that  for  all  t  2  tQ 


-vCt-t) 

x(t)|  +  |X(t)l  *  Ote  , 

-  M  •  * 

(3.2) 

5 (t-t  ) 

x(t)|  +  |X(t)|  *  0e 

(3.3) 

where  Y  is  a  linear  subspace  of  R  and  |x(t)|  and  |X(t)|  are  norms  of 
the  n-dimensional  vectors  x(t)  and  X(t). 

This  chapter  shows  how,  under  suitable  conditions,  "dichotomy 
transformations"  are  constructed  which  diagonalize  (3.1)  into  two  n- 
diroe ns ional  systems,  one  exponentially  stable  in  forward  time  and  the 
other  exponentially  stable  in  reverse  time.  In  this  way  x(t)  and  X ( t ) 
can  be  found  by  solving  differential  equations  in  their  stable  direction. 


1 
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This  development  is  purposely  introduced  to  stress  similarities  between 
(3.1)  and  the  singularly  perturbed  system 


A(t) 


L-Q(t) 


-S(t) 


(3.4) 


A  typical  application  is  the  optimization  of 


x  =  A(t)x  +  B(t)u  (3.5) 

with  respect  to 

.  T 

J  *  J  X^x ' Q< c>x  +  u'R(t)u]dt  (3.6) 

*"0 

with  x  fixed  at  both  ends.  It  in  this  problem  the  system  (3.1),  with 

S(t)  *  B(t )R (t )B ' ( t )  ,  possesses  an  exponential  dichotomy,  and  if  the 

interval  [t  .t]  is  large,  then  the  corresponding  TPBV  problem  can  be 
o 

approximately  solved  by  solving  two  independent  initial  value  problems. 


32  Negative  Definite  Rlccatl  Matrix 

Conditions  for  existence  and  uniqueness  of  the  symmetrical  positive 
definite  solution  P(t)  of 


K  =  -KA(t)  -  A ' ( t ) K  +  KS (t)K  -  Q(t), 


(3.7) 


subject  to  a  symmetric  positive  semi-definite  end  condition  tt. 
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K  =  TT  at  t  *  T,  (3.8) 

are  known  as  well  as  the  conditions  for  existence  and  uniqueness  of  the 
symnetrical  positive  definite  root  of  the  time  invariant  system 

-  KA  -  A'K  +  KSK  -  Q  =  0  .  (3.9) 

In  the  construction  of  dichotomy  transformations  in  this  chapter,  symmetrical 
negative  definite  solutions  N(t)  and  of  (3.7)  and  (3.9)  will  also  be 
used.  The  transformations  follow  after  first  presenting  two  lemmas  which 
depend  upon  the  hypothesis 

H  3.2.1  Let  for  all  teC^.l]  the  matrices  A(t),  B(t),  Q(t)  and  R(t) 
be  continuously  differentiable  functions  of  t,  Q(t)  be  symmetric  positive 
semi-definite  and  R(t)  be  symmetric  positive  definite. 

Lemma  3.2.2  Let  H  3.2.1  be  satisfied.  Then  for  all  t  c  [tQ,T] 
there  exists  a  unique  symmetric  negative  definite  solution  N(t)  of  (3.7) 
subject  to  an  Initial  condition 


K  ■  -r  at  t  ■  t 

o 


(3.10) 


where  T  is  a  synmetric  positive  semi-definite  matrix. 
Proof:  Consider  the  minimization  of 


J 


1 

2 


T 

J[x'Q(to+T-T)x  +  u'R(to+T-T)u]dT 
'o 


(3.11) 
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subject  to 


~  =  -A(tQ+T-T)x  -  B(tQ+T-T)u  (3.12) 

with  x  given  at  t  *  t  and  free  at  r  *  T.  The  corresponding  Riccati  equation 

A 

~  *  KA(t  +T-t)  +  A ' (t  +T-T)K  +  KS(t  +T-T)K  -  Q(t  +T-T)  (3.13) 

dT  o  o  o  o 

A 

has  a  unique  positive  definite  solution  K(t)  satisfying  the  end  condition 

K  -  r  at  r  -  T  (3.14) 


The  substitution  of  t  *  tQ-+T-t  in  (3.13)  and  (3.14)  shows  that  N  K  -k(to+T-t) 
uniquely  satisfies  (3.7)  and  (3.10). 

Lemma  3.2.3  Let  H  3.2.1  be  satisfied  where  A,  B,  R  and  Q  *  C'C  are 
constant  matrices,  [a,b]  is  a  controllable  pair  and  [a,c]  Is  an  observable 
pair.  Then  the  algebrlac  equation  (3.9)  has  a  unique  symmetrical  negative 
definite  root  N  ,  and  -(A-SN  )  is  a  stable  matrix. 

Proof :  In  (3.11).  disregard  the  terminal  cost  term  anl  let  T  -*  ®. 

Then  (3.11)  and  (3.12)  constitute  a  well  defined  infinite  time  regulator 
problem.  Thus 


KA  +  A'K  +  KSK  -  Q  ■  0 


(3.15) 


has  the  unique  symmetrical  positive  definite  root  and  -[a+SP^]  ia  a 
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stable  matrix.  The  substitution  of  for  P  into  (3.15)  then  shows  that 
is  the  unique  symmetrical  negative  definite  root  of  (3.9).  The  unique¬ 
ness  is  a  direct  consequence  of  the  non-singular  transformation  *  -N^ 
and  the  uniqueness  of  P^  of  (3.15). 

3.3  Dichotomy  Transformations 

Note  that  if  z  =  W(t)5  transforms  z  =  L(t)z  into  £  ■  D(t)£,  then 

V  “  L(t)W  -  WD(t)  .  (3.16) 

We  will  consider  L(t)  as  the  2n  by  2n  coefficient  matrix  in  (3.1)  and 
construct  a  nonsingular  transformation  W(t)  which  will  make  the  resulting 
matrix  D(t)  block-diagonal. 

Lemma  3.3.1  Under  the  conditions  of  Lemma  3.2.2,  the  transformation 


“x(t)“ 

"  I 

I  - 

r  y(t)  i 

-X(t)- 

-  P(t) 

N(t>- 

-T|(t)- 

is  nonsingular  for  all  t  e  [tQ,T]  and  t-ansforms  (3.1)  into 


T|_l  L 


■A(t)-S(t)P(t) 


1 

_ 1 

L  Tl  J 

(3. 18) 


Proof :  Using  (3.1),  (3.17)  and  (3.18)  to  form  (3.16)  and  noting 
that  P(t)  and  N(t)  satisfy  (3.7),  (3.16)  is  oCLisfied  as  an  identity. 
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Transformation  (3.17)  is  nonsingular  since  both  P(t)  and  P(t)  -  N(t)  are 
nonsingular. 

Theorem  3.3.2  Let  the  assumptions  of  Lenina  3.2.3  be  satisfied  and 
use  tt  =  and  -F  =  in  (3.8)  and  (3.10).  Then  the  transformation  (3.17) 
becomes 


"x(tf 

'l 

I 

"y(t)‘ 

_x(t)_ 

-p» 

CO 

JUt). 

(3.19) 


and  the  subspace  Y  in  (3.2)  is  defined  by  T)  =  0. 

Proof :  Note  that  W  *  0  and  (3.16)  is  satisfied.  Since  A  -  SP^  is 
stable  and  -  (A  -  SN  )  is  stable  by  Lemma  3.2.3,  inequality  (3.2)  holds 


only  when  T)(tQ)  *  0. 


Theorem  3.3.3  Consider  (3.5)  and  (3.6)  and,  using  T  *  ®  and 
Q(t )  =  C ' (t)C(t) ,  where  C(t)x(t)  is  the  output  of  (3.5),  define  an  output 
regulator  problem  as  in  £22].  when  this  problem  satisfies  the  stability 
theorem  by  Kalman  £22,  Theorem  6.10],  then  the  subspace  Y  generating  the 
dichotomy  (3.2),  (3.3)  is  defined  by  T]  *>  0  in  (3.17). 

Proof :  From  [22],  it  is  known  that 


^  =  L A ( t)  -  S (t)P(t)]y 


(3.20) 


is  uniformly  asymptotically  stable.  From  the  definitions  of  uniform 
complete  controllability  and  observability  [22]  applied  to  (3.11)  and 
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(3.12),  and  using  the  same  change  o£  time  variables  as  in  Lemma  3.2.2,  it 
can  also  be  shown  that 

=  CA(t)  -  S(t)N(t)]T|  ,  (3.21) 

is  uniformly  asymptotically  stable  in  reverse  time. 

Thus  (3.17)  and  (3.19)  are  transformations  which  make  transparent 
the  dichotomy  properties  of  (3.1)  guaranteed  to  exist  by  the  assumptions 
in  Lemma  3.2.3  for  time* invariant  systems  and  in  Theorem  3.3.3  for  time- 
varying  systems.  P(t)  and  N(t)  are  related  by  the  expression 

N(t)  =  P(t)  -  |  H’l(t)  (3.22) 

where  H(t)  is  the  unique  synmetrical  positive  definite  solution  of 

=  [A(t)-S(t)P(c)]H  +  H[A(t)-S(t)P(t)]'  +  \  S(t)  (3.23) 

with  H  *  [P(tQ)  -  N(tQ)]  1  at  t  =  tQ.  This  follows  upon  recognition 
that  N(t),  P(t),  and  H(t)  are  unique  solutions  of  their  respective  dif¬ 
ferential  equations  and  that  H(t)  defined  in  (3.22)  satisfies  (3.23)  as 
an  identity.  Another  transformation  which  could  have  been  used  to  show 
the  dichotomy  properties  is  given  by 


'x(t)' 

I 

H(t) 

'  y(t)  ‘ 

_*(t)_ 

_p(t) 

N(t)H(t)_ 

(3.24) 


MmM m 
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which  transforms  (3.1)  into 


y 

"  A(t)-S(t)P(t)  0 

"  y 

A. 

JS 

0  -[A(t)-S(t)P(t)]'_ 

-  71  - 

(3.25) 


For  a  time  invariant  problem  a  similar  transformation  was  used  in  [33]. 
3.4  An  Application 

Consider  the  minimization  of  (3.6)  subject  to  (3.5)  and  with  x 
fixed  at  both  ends. 


x(tQ)  -  x°, 


x(T)  -  xT. 


(3.26) 


To  solve  the  boundary  value  problem  (3.1)  and  (3.26)  using  the  transforms- 
o  T 

tion  (3.19),  y  and  T)  are  determined  from 


r  o  -i 


x  J  L*  (T,tQ) 


Y(to,T)- 


i 

vs 

o 

_ i 

_7]T  J 

(3.27) 


where  $(t,tQ)  and  ^(t,!)  are  the  fundamental  matrices  of  (3.20)  and  (3.21) 
respectively.  However,  if  (3.1)  possesses  the  dichotomy  (3.2),  (3.3)  and 

a 

if  the  interval  [to,T]  is  sufficiently  large,  then  | Y ( t^.T)  |«1, 
l§(T,to)|«l  and 


(3.28) 


Using  these  boundary  conditions,  the  approximate  y(t)  and  T)(t)  are  obtained 
from  the  independent  initial  value  problems  (3.20)  and  (3.21).  The  approx! 
mate  solution  of  the  boundary  value  problem  (3.1)  and  (3.26)  is  then  found 
us  ing 


x(t)  =  y(t)  +  T)(t) 

X(t)  =  P(t)y(t)  +  N(t)1]  (t) 


(3.29) 


This  procedure  is  particularly  convenient  when  A,  B,  Q  and  R  are  constant 
matrices,  since  then  P(t)  *  and  N(t)  ®  can  be  obtained  by  an 
algebraic  method. 

3.5  Example 

Consider  finding  an  approximate  solution  of  system  (3.1)  satisfying 
(3.26)  where  A  =  0.5,  B  =  1,  Q  *  2,  and  R  =  1.  Then  (3.1)  becomes 


x(0)  =  x° 
x(T)  *  xT 


(3.30) 


For  this  example,  Po  *  2  is  the  positive  and  *  -1  is  the  negative  root  of 

K2  -  K  -  2  *  0  .  (3.31) 


The  transformation 
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u 


u 


x(t) 


U<*oJ 


y(t) 


LTKt)J 


(3.32) 


trans£orms  (3.30)  into 


y 

It 


•1.5 


L  0  1. 5  J 


LH. 


(3.33) 


and  (3.27)  gives 


o  o  ,  _T  *1*  5T 
x  *  y  t  i|  e 


T  „  o  -1.5T  .  t,T 
x  =  y  e  +  i| 


(3.34) 


If  T  is  large,  y°  »  T]  e and  7)^»  y°e  '  Hence 


o  -1.5t  .  T  1. 5(t-T) 
x(t)  «xe  +xe 

,  o  -i.5t  X  1. 5(t-T) 
X  (t)  «2xe  -xe 


(3.35) 


Note  that  both  y(t)  and  T) ( t)  are  obtained  by  solving  (3.20)  and  (3.21) 
in  their  stable  directions. 

3.6  Discussion 

An  interpretation  of  (3.20)  is  that  it  is  the  solution  of  a  regulator 
problem  whose  performance  index  has  a  penalty  term  at  t  ■  T  and  whose  system 
is  subject  to  an  Initial  boundary  condition  at  t  *  tQ.  Similarly,  an 
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interpretation  of  (3.21)  is  that  it  is  the  solution  of  a  regulator  problem 
whose  performance  index  has  a  penalty  term  at  t  ■  t  and  whose  system  is 
subject  to  a  final  boundary  condition  at  t  ■  T.  The  stability  of  these 
regulated  systems  is  assured  by  the  assumptions  given  in  Lemma  3.2.3  and 
Theorem  3.3.3.  For  a  sufficiently  large  interval,  a  simplifying  approxi¬ 
mation  is  possible  and  the  TPBV  problem  is  approximately  solved  by  solving 

m  * 

only  initial  value  regulated  systems  and  adding  the  resulting  solutions. 

As  either  the  time  constant  associated  with  the  exponential  bound  on  the  -  - 

regulator  solutions  is  decreased  or  the  time  interval  Increased,  the  TPBV 

solution  appears  as  the  summation  of  two  decaying  transients;  one  at  each 

end  of  the  time  interval.  For  a  very  small  time  constant,  the  transient 

behavior  at  the  initial  time  could  be  approximated  by  the  solution  of 

(3.20)  whose  coefficient  matrix  is  assumed  constant  (the  functional  value 

at  t  =  tQ) .  Similarly,  the  transient  behavior  at  the  final  time  could  be 

approximated  by  the  solution  of  (3.21)  whose  coefficient  matrix  is 

assumed  constant  (the  functional  value  at  t  =  T) .  The  differential 

equations  (3.20)  and  (3.21)  are  called  "stiff"  when  the  transients  occur 

very  rapidly. 

3.7  A  Preliminary  Singular  Perturbation  Problem 

It  will  now  be  shown  that  the  solution  of  the  singularly  perturbed 
time  invariant  system 


(3.36) 


*su 


satisfying  the  boundary  conditions 


x(tQ)  *  x°,  x(T)  =  xT  (3.37) 

behaves  similar  to  the  solution  of  the  TPBV  problem  (3.1)  satisfying 
(3.37)  under  suitable  stability  conditions  and  for  ^  sufficiently  small. 
Specifically,  the  previous  requirement  that  the  time  interval  [t^.ll  be 
large  relative  to  the  transient  intervals  at  the  initial  and  final  times 
will  be  shown  equivalent  to  the  condition  that  p,  be  sufficiently  small 
for  the  specified  interval  [tQ,x]  of  the  problem.  Furthermore,  it  will 
be  shown  that  an  approximate  solution  of. (3.36)  and. (3. 37)  is  given  by  the 
sunination  of  solutions  of  two  time- invariant  regulated  systems. 

If  the  hypotheses  of  Lemma  3.2.3  are  satisfied,  then  there  exists 
a  unique  symmetrical  positive  definite  constant  solution  and  a  unique 
symmetrical  negative  definite  constant  solution  of  the  Riccati  equation 

pK  +  KA  +  A'K  -  KSK  +  Q  -  0  (3.38) 


for  (3.36).  Also,  [a  -  SP^]  and  -  [A  -  SN^]  are  both  stable  matrices. 
Thus  (3.36)  is  transformed  by 


(3.39) 


into  the  two  decoupled  singularly  perturbed  systems 


Hy  =  (A-SP00)y 
nfl  -  (A-SN  )T1  . 
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(3.40) 

(3.41) 


Assuming  that  an  initial  condition  y  is  given  for  (3.40)  and  a  final 


condition  Tf  is  given  for  (3.41),  the  solutions  for  y  and  T\  are  given  by 


y  =  e 


(A-sr.)(t-t  )/i* 

y 


(A-SN  )  (t-t  )  /pi 
T|  -  e  °  r 


(3.42) 

(3.43) 


The  boundary  conditions  x°,  xT  are  related  to  those  of  y°,  T\T  by 


r-  o 
x 


T 

«-  x  J 


(A-SNoo)(to-T)/> 


i-e 


(A-SP^)  (T-tQ)  /pi 


ry  i 

i 

H 

1 _ 

(3.44) 


Clearly  for  whatever  t  and  T  (t  £  T)  have  been  given,  it  is  always 


possible  to  find  a  pi*  >  0  such  that  for  all  pi  c  [0,pi*] 


(A-SPw)(T-to)/^ 

(A-SNa>)(to-T)/lx 

e 

«  i. 

e 

«  1 


1 


I 


t  > 

i 

i 


since  [A-SP^]  and  -[A-SN^]  are  stable  matrices.  Thus 


o 

y 


o 

03  X 


T 

as  X 


(3.43) 


for  ^ 


39 


Hence  the  approximate  x(t,|j,)  solution  is  given  by 


(A-SP^Xt-t  )/u  (A-SN^Ht-Tj/n 

x(tf|j,)  =  e  x°  +  e  x  (3.46) 


This  simplified  problem  points  out  the  interchanging  roles  of  T 


and  (j.  and  represents  a  special  case  of  a  more  general  problem  rigorously 
analyzed  in  Chapter  4. 


4.  FIXED  END- POINT  PROBLEM:  THEORY 


40 


I 

I 
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4.1  Introduction  and  Problem  Statement  ^ 

The  goal  of  this  chapter  is  to  develop  an  approximation  of  the 
optimal  solution  of  a  trajectory  optimization  problem  over  the  entire  ^ 

operation  interval  [t  ,T] .  An  approximate  solution  is  sought  instead  of 
the  actual  solution  since  the  latter  is  often  quite  difficult  to  find 
using  existing  methods.  The  complication  is  a  result  of  both  widely 

*-  * 

varying  decay  transients  and  widely  varying  growth  transients  associated 
with  the  solution  of  a  TPBV  problem.  The  design  objectives  for  the 
approx imare  design  solution  is: 

(i)  solution  of  a  lower-dimensional  problem  than  the  original 

problem  when  the  approximation  is  to  be  valid  only  on  an  open 

interval  of  [ t  ,t] ; 

o 

(ii)  accounting  for  boundary  layer  phenomena  by  finding  correction 
terms  which,  when  added  to  the  reduced  solution,  make  the 
approximation  valid  over  the  whole  interval  [to,T]; 

(ill)  determination  of  correction  terms  separately  in  a  stretched 
time  scale  thus  avoiding  "stiff"  problems. 

This  approximation  design  is  developed  for  the  problem  of  optimally 
controlling  the  (n^  +  n^) -dimens lonal  system 


*1  *  Aj^Ct.pOXj.  +  A12(t,n)x2  +  B^t.uju 
y,x2  “  A21(t,y.)x1  +  A22(t,^)x2  +  B2(t,u)u 


a 


(4.1) 
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with  respect  to  the  performance  index 


J 


if 


T/rx 


Lx2  J 


"Oil  Qiz‘ 

1 

X 

h* 

_ 1 

-<,12  Q22- 

- ) 

02 

X 

_ 1 

+  u'Ru  1 dt 


(4.2) 


where  the  boundary  conditions  for  (4.1)  are 


x 


x 


1 

1 


and  X£  “  x^ 

.  T 

and  x^  *  x^ 


at  t  -  t 

o 

at  t  «  T 


(4.3) 


The  following  hypotheses  are  made  about  the  matrices  appearing  in  (4.1) 
and  (4.2). 

H  4.1.1  For  all  t  e  [t^.T],  p,  e  [0,^*]  the  symmetrical  matrix 

Q  =  Q(t,n)  is  positive  semi-definite,  and  R  ■  R(t,^)  is  positive  definite. 

H  4.1.2  For  all  t  e  [t  ,T]  ,  g.  e  the  elements  of  the  matrices 

————  o 

in  (4,1)  and  (4.2)  are  three  times  continuously  differentiable  functions  of 
their  arguments. 

From  the  optimality  conditions  for  (4.1),  (4.2),  it  follows  that 
u  =  -R_l(B[  \x  +  \2)  (4.4) 


and  hence 
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11 

-Sll 

A12 

-S12 

'll 

-Aii 

-«12 

_A21 

21 

_S12 

A22 

"S22 

12 

~A12 

-q22 

”A22 

Using 


(4.5) 


the  system  (4.5)  is  rewritten  in  the  compact  form 


(4.6) 


where  the  definition  of  is  evident  from  comparison  of  (4.6)  with  (4.5). 
When  g,  is  set  equal  to  zero,  the  2(n^  +  n^) -dimens ional  system  (4.6) 
reduces  to  a  2n^-dimens ional  system,  and  if  the  indicated  inverse  exists, 
the  reduced  system  becomes 


(D 


11 


°12°22  °21)Z1 


(4.7) 


Variable  is  not  present  in  the  differential  system  (4.7)  but  is 
algebraically  related  to  z^  by 


"^22  ^21zl 


(4.8) 
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Thus  in  general  will  not  satisfy  the  boundary  conditions  in  (4.3). 

A  solution  z ^  satisfying  (4.7)  and  the  x^  boundary  conditions  of  (4.3)  with 
the  corresponding  z2  obtained  from  (4.8)  is  called  a  reduced  solution. 

The  approximation  is  based  on  the  requirement  that  an  auxiliary  time 
invariant  system  depending  on  a  fixed  parameter  T) 

dx 

~  =  A22(T),0)x2  +  B2(T1,0)u  (4.9) 


be  stabilizable  for  each  T)  in  the  interval  [t^T].  The  full  meaning  of 
stabilizability  of  system  (4.9)  will  be  clear  later  when  this  system 
appears  in  so  called  "layer  regulators"  and  makes  it  possible  to  use 
algebraic  Riccati  equations  for  calculation  of  the  correction  terms.  Con¬ 
trollability  and  observability  hypothesis  H  4.1.3  used  here  is  more 
restrictive  than  the  stabilizability  requirement  but  simplifies  the  forth¬ 
coming  derivations.  This  is  the  crucial  hypothesis  of  Theorem  4.2.1. 

H  4.1.3  For  all  t  «  [t  ,T] , 

-  o 


rank 


-n2"1-  I 

LB2,A22B2,A22B2* *  *  * ,A22  B2j  *  ^2 


2- 


r_  _  2-  -  n2_*-"i 

rank  |^C2  ,A22C2  ’  ^22^  C2»...f(A22)  ^2J  "  n2 


(4.10) 

(4.11) 


It  is  seen  that  hypothesis  H  4.1.3  guarantees  the  existence  of  the 
inverse  in  (4.7,  and  (4.8).  The  last  hypothesis  needed  is 

H  4.1.4  There  exists  a  unique (bounded)  reduced  solution  satisfying 
the  x^  boundary  conditions  in  (4.3). 
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4.2  Main  Theorem 

The  theorem  of  this  section  establishes  the  existence  of  an 
approximate  solution  for  the  trajectory  optimization  problem  (4.1)-(4.3) 
which  accomplishes  all  of  the  design  objectives  (i)-(iii)  set  forth  in 
section  4.1.  This  permits  numerically  complicated  problems  to  be  approxi¬ 
mately  solved  in  a  simplified  manner. 

Theorem  4.2,1  Let  H  4.1.1,  H  4.1.2,  H  4.1.3,  and  H  4.1.4  be  satisfied 
for  problem  (4.1),  (4.2),  and  (4.3).  Then  there  exists  a  positive  con¬ 
stant  p*  such  that  for  p,  *  p*  and  t  e  Ct^.l] 

x1(t,p,)  =  xL(t)  +  0(n) 

x?(t,H)  ■  x„(t)  +  JL(-r)  +  +  0(h) 

z  (4.12) 

XL(t,H)  =  XL(  t)  +  0(h) 

X 2 ( t , h)  -  X2(t)  +  P22(to)£2(T)  +  N22(T )^(a)  +  0(H)  • 

Here  ^(t)  is  the  solution  of  the  "left"  layer  system 

—  *  [*22(V  '  ®22(V*22(to*]  h  (4*l3) 

subject  to  initial  condition 

\ 

^  “  x2°  '  x2(to)  at  t  ■  0 
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where  t  *  (t-tQ)/(j,,  £2(a)  *-s  th®  solution  of  the  "right"  layer  system 


(4.14) 


subject  to  terminal  condition 


*2  -  x2T  -  x2(T)  at  or  =  0 

where  a  =  (t-T)/p,,  and  ^22^0^  an<*  are  t^e  symmetrl-ca^  positive  and 

negative  definite  algebraic  solutions  of 


*22K22  +  K22*22  “  K22^22K22  +  ^22  “  0  (4.15) 

evaluated  at  tQ  and  T  respectively. 

Discussion:  This  theorem  can  be  used  for  different  types  of 

approximations  of  the  optimal  solution.  For  an  approximation  on  the  interval 
12  12 

[t  ,t  J  where  tQ  <  t  St  <  T,  one  neglects  the  I2>^2  terms  in  (4. 12)  and 
approximates  the  high-dimensional  solution  by  the  low-dimensional  reduced 
solution  found  from  (4.7),  (4.8).  This  approximation  is  within  Q(p.)  for  p, 
suff iciet.tly  small.  For  the  approximation  to  be  valid  on  the  interval 
[tQ,t  ],  the  left  layer  correction  term  is  added  to  the  reduced  solution;  for 
the  approximation  to  be  valid  on  the  interval  [t*,T],  the  right  layer 
correction  term  is  added  to  the  reduced  solution.  When  both  left  and  rigi/. 
layer  correction  terms  are  added,  the  approximation  is  valid  on  the  entire 
interval  [*■  ,T], 

G 
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It  should  be  noted  that  the  theorem  has  the  desired  lower-dimensional 
and  time  scale  separation  properties.  The  correction  terms  are  evaluated  inde¬ 
pendently  and  each  is  the  solution  of  a  time  invariant  initial  value  problem. 
For  computation  of  only  the  symmetrical  positive  definite  root  at 
t  =  t  needs  to  be  found  from  the  algebraic  Riccati  equation  (4.15).  The 
symmetrical  negative  root  of  (4.15)  at  t  =  T  is  needed  for 

Finally,  a  similar  theorem  could  be  formulated  for  an  asymptotic 
expansion  as  common  in  singular  perturbation  theory.  This  was  not  done  here 
in  order  to  provide  a  clearer  proof  of  the  theorem. 

The  proof  of  this  theorem  will  be  given  after  first  proving  a  set 
of  lemmas.  The  first  two  lemmas  are  used  to  establish  certain  properties  of 
two  different  solutions  of  a  singularly  perturbed  Riccati  system.  One  solution 
is  symmetrical  positive  semi-definite  and  the  other  is  symmetrical  negative 
semi-definite.  The  third  lemma  uses  these  solutions  in  defining  a  transforma¬ 
tion  which  enables  one  to  solve  two  initial  value  problems  in  place  of  a 
TPBV  problem. 

4.3  Properties  of  Riccati  Matrices 

Let  the  co-state  variables  and  X2  related  to  the  state 
variables  x^  and  by  the  Riccati  transformation 


~h ' 

H 

1 _ 

1 

CM 

r—i 

* 

rl 

r 

r-H 

X 

\ _ 

jiX2  . 

»S*12 

1 

CM 

CM 

_X2  J 

(4.16) 


The  Riccati  equations  resulting  after  elimination  of  X^  and  X2  from  (4.5) 
using  (4.16)  are  given  by 
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K11  "  'Kll(All"S12K12)  ’  (All"S12K12)  K11 


‘  K12A21  '  A21K12  +  K11S11K11  +  K12S22K12  "  Q11 
^12  =  -K12^A22"S22K22^  "  K11A12  +  K11S12K22  "  A21K22  *  Q12 


-  m-(a1[k12-k11s11k12-k12s1^k12) 


^22  _  _K22A22  ‘  A22K22  +  K22S22K22  "  Q22 

-  p[k12(ai2-S12K22^  +  ^A12“S12K22^  K12  " ^  K12S11K12] 


(4.17a) 


(4.17b) 


(4.17c) 


The  corresponding  reduced  Riccati  system  obtained  by  setting  (i  ■  0  in  (4.17)  Is 


0  = 


i12KlP  '  <AirS12KlPKll 

.  '  A21K12  +  Kll®llKll  +  K12®22K12  “  ^11 

(4.18a) 

;22K22)  '  K11A12  +  K11®12K22  _  A21K22  '  **12 

(4.18b) 

A22K22  +  K22^22K22  “  **22 

(4.18c) 

and  is  to  satisfy  the  same  boundary  condition  as  imposed  on  for  the 
solution  of  (4.17).  In  general,  it  cannot  satisfy  the  end  conditions  for  K^2 
and  ^2*  Since  the  system  (4.18)  has  an  algebraic  part,  it  can  have  many 
solutions  satisfying  the  symmetrical  positive  semi-definite  boundary  condition 
on  at  t  =  T.  Only  one  of  these  solutions  denoted  by  meets  the  previous 
hypotheses  H  4.1.1  -  H  4.1.3  and  the  requirement  that  K.^,  K22  by  symmetrical 
positive  semi-definite  matrices  for  all  t  c  [tQ,T].  When  K^2  and  K22  at  t  *  T 
are  equal  to  the  respective  boundary  conditions  imposed  on  K^2  and  K22  in 
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(4.17) ,  then  the  solution  of  (4.18)  is  designated  by  P^  and  the  solution  of 

(4.17)  satisfying  these  boundary  conditions  is  designated  by  P4j(t,p,).  Like¬ 
wise,  of  the  many  solutions  of  (4.18)  satisfying  the  symmetrical  negative  semi- 
definite  boundary  condition  on  at  t  =  tQ,  there  is  only  one  satis¬ 
fying  the  conditions  imposed.  These  conditions  are:  the  previous  hypotheses 

H  4.1.1  -  H  4.1.3  must  be  met,  Nn  and  N22  are  to  be  symmetrical  negative 
semi-definite  for  all  t  e  [tQ,T],  and  the  values  of  N^2  and  N22  at  t  ■  tfl 
are  to  be  the  same  as  the  boundary  conditions  imposed  on  these  variables  in 

(4.17) .  The  solution  of  (4.17)  satisfying  these  boundary  conditions  is 
designated  by  N„(t,p,). 

The  basis  of  the  proof  of  the  main  theorem  is  the  existence  of  the 
Riccati  solutions  The  singularly  perturbed  Riccati  solution  of 

(4.17)  is  known  to  generally  have  a  boundary  layer  jump  at  t  =  T  when  the 
boundary  conditions  are  given  at  t  =  T.  Thus  the  Riccati  solution  would 
rarely  be  continuous  for  all  t  e  [t^.T],  p,  e  [0,&A  ]  which  is  a  crucial  require¬ 
ment  in  the  approach  used  to  prove  our  Main  Theorem.  But  by  properly  selecting 
the  boundary  conditions  for  (4.17),  the  boundary  layer  jumps  have  been 
eliminated  and  the  continuity  of  P^(t,p,)  and  N^(t,(x)  can  be  guaranteed. 

Lemma  4,3.1  Let  H  4.1.1,  H  4.1.2,  and  H  4.1,3  be  satisfied  and  let  the 
boundary  conditions  for  (4.17)  be  given  by 
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at  t  =  T 


(4.19) 


where  TT^(tJ,)  is  an  arbitrary  symmetrical  positive  semi-definite  matrix  which 
is  a  three  times  continuously  differentiable  function  of  |±  for  all  p,  e  [0,p,*]. 

ic  * 

Then  there  exists  a  p,  >0  such  that  for  all  p,  £  p,  the  unique  solution 
PjjCt.M-)  of  (4.17)  satisfying  (4.19)  can  be  asymptotically  approximated  on 
the  entire  interval  [tQ,T]  by 

P.jU.n)  =  P^  +  0(n)  (i,j  -  1,2)  (4.20) 

where  P^  and  P^2  are  symmetrical  positive  definite  matrices,  except  possibly 
at  t  *  T  where  P^  can  be  positive  semi-def inite .  Furthermore  [A22-S22P22] 
is  a  stable  matrix. 

The  proof  is  based  on  showing  that  the  hypotheses  of  the  singularly 
perturbed  initial  value  Lemma  A. 4  of  the  appendix  are  satisfied.  In  addition 
to  certain  smoothness  assumptions,  these  hypotheses  require  first,  that  the 
reduced  solution  exists,  and  second,  the  stability  of  the  boundary  layer 
equation.  This  proof  in  part  uses  facts  established  in  [55]  but  differs  from 
the  proof  given  there  in  two  ways.  First  the  problem  considered  here  requires 
only  that  the  initial  conditions  of  the  Riccati  problem  lie  within  a  neighbor¬ 
hood  of  the  reduced  Riccati  solution  at  t  =  T.  Thus  global  properties,  which 
can  be  proven,  are  not  needed  here.  Second,  a  proof  of  boundary  layer 
stability  is  given  where  Kronecker  products  were  not  needed  and  the  continuity 

of  P,  .  at  p,  =  0  is  established, 
ij 

Proof  of  Lemma  4.3.1;  The  existence  of  the  reduced  solution  will  first 
be  shown  and  then  boundary  layer  stability;  both  of  which  are  hypotheses  of 
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the  appendix.  A  unique  algebraic  symmetrical  positive  definite  root  P 22  of  (4.18c) 
is  guaranteed  to  exist  for  all  t  e  [to,T]  by  H  4.1.1  and  H  4.1.3.  This  can 
easily  be  seen  at  a  fixed  time  by  interpreting  (4.18c)  as  the  Riccati  equation 
resulting  from  a  time  invariant  optimal  regulator  problem..  The  continuity  of 


i?22(t)  for  t  e  £to,T]  then  follows  from  the  implicit  function  theorem  and  H  4.1.2. 
This  interpretation  also  makes  evident  that  ^22~^22^22^  *"S  a  sta^^e  “a^ix 
for  each  t  e  [tQ,T].  From  this  and  (4.18b)  it  follows  that  P^2  is  uniquely 
expressible  in  terms  of  P^  and  P22.  T^ie  existence  of  the  unique  symmetrical 
positive  definite  matrix  P^  (semi-definite  at  t  =  T  if  tt^  is  semi-definite 
there)  was  established  in  [55]  by  showing  it  was  the  solution  of  a  Riccati 
system  similar  to  (3.6).  Thus  the  reduced  solution  P„  exists.  The  stability 
of  the  boundary  layer  equation 


dK 


dr  ~  “*12**22“®22*22*  "  ^11*12  +  *11^2*22  '  *21*22  "  ^12 


dK 


22  A  ^  a  *  .  a  . 

—  =  -K22A22  -  A2^K22  +  K22S22K22  -  Q22 


(4.21) 


will  now  be  shown  about  the  reduced  solution  K. .  =  P, ,  for  each  t  e  [t  ,T], 

ij  ij  o’ 

A  — 

The  linearized  system  of  (4.21)  about  the  reduced  solution  where  =  P^, 

A  _  A  „ 

K.12  =  P12  +  6K^2»  and  K22  =  P22  H  6K22  ,3ecomes 


d6K 


12 


dT 

d6K 


22 


dT 


-6K12(A22-S22P22)  -  (A2i"^llS12’P12S22^6K22 


-6K22(A22-S22P22)  -  (A22-S22P22)5K22 


(4.22a) 


(4.22b) 


whose  coefficient  mscrices  are  functions  of  the  fixed  parameter  t.  Since 
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[A22-S22^22^  a  8table  matrix,  it  immediately  follows  that  the  solution  of 

(4.22)  is  asynpto tic ally  stable.  Upon  substitution  of  this  solution  in 

(4.22a)  and  again  noting  the  presence  of  the  stable  matrix  ^22*822^22^  * 

then  follows  that  the  solution  of  (4.22a)  is  asymptotically  stable.  Since 

the  smoothness  assumptions  are  met,  it  remains  only  to  note  that  the  boundary 

layer  correction  terms  for  P  and  at  t  *  T  are  eliminated  as  a  direct 

consequence  of  the  special  way  in  which  the  boundary  conditions  were  chosen 

in  the  hypothesis  of  this  lemma.  Thus  satisfaction  of  Lemma  A. 4  guarantees 

★ 

the  existence  of  the  M*  of  this  lemma* 

Lemma  4.3.2  Let  H  4.1.1,  H  4.1.2,  and  H  4.1.3  be  satisfied  and  let  the 
boundary  conditions  for  (4.17)  be  given  by 


(4.23) 


where  -r^(g,)  is  an  arbitrary  symmetrical  negative  semi-definite  matrix 
which  is  three  times  continuously  differentiable  function  of  p  for  all 
p  e  [0,p*].  Then  there  exists  a  p*  >  0  such  that  for  all  p  £  p*,  the 
unique  solution  N^(t,p)  of  (4.17)  satisfying  (4.19)  can  be  asymptotically 
approximated  in  the  entire  interval  [t  ,t]  by 


Ntj(t,p)  -  N  +  0(p)  (i,j  -  1,2) 


(4.24) 


where  and  N22  are  symmetrical  negative  definite  matrices,  except 


possibly  at  t  ■  T  where  Nj^  can  be  negative  semi-deflnlte.  Furthermore, 
-  Ca22-S22N22]  is  a  stable  matrix. 

Proof ;  Consider  the  Riccati  system 


dK 


dy  =  "^ll('All‘S12^12)  ‘  *’AU-S  12*12*  ^11  +  *12A21 


+  A2[Kx^  +  K11S11K11  +  K12S22K1^  -  Q 
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(4.25a) 


dK 


_L2 

dy 


M-  a,  '^^■AliKl2‘KllSllK12‘Kl2S12K12^  "  K12^'A22‘S22K22^ 
+  K1lAi2  +  K11S12K22  +  A2jK22  -  Q12 


(4.25b) 


22  P  «  A  *'**,*. 

^  ~dy  ^K12^"A12"S12K22^  +  ^‘A12~S12K22^  K12_M,K12S11K12^ 

A  (  A  A  A 

+  K22A22  +  A22K22  +  K22S22K22  -  Q22 


(4.25c) 


whose  coefficients  are  functions  of  tQ  +  T  -  y  and  whose  boundary  conditions 
are  given  by 


A 

Ku 

**12 

'  Tn™ 

-MN12(M-) 

.*12 

^22  _ 

-^(p) 

-w22M 

(4.26) 


Noting  that  (4.25)  and  (4.26)  satisfy  l.cmma  4.3.1  and  making  the  substitution 
y  *  tQ  +  T  -  t  in  (4.25)  and  (4.26),  it  is  clear  +  T-t) 


uniquely  satisfies  (4.17)  and  (4.26) 
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4.4  Dichotomy  Transformation 

Let  the  following  transformation  be  defined 


or  equivalently 


where 


nl 

nl 

pu 

N11 

*P12 

^i2 

0 

0 

I 

n2 

I 

n2 

p  1 
*12 

N12 

P22 

N22 

(4.27) 


w  u 

11  "12 


w  w 

"21  22 


(4.28) 


r 

i  i. 


(4.29) 


and  the  definition  of  is  evident  upon  comparison  of  (4.28)  with  (4.27). 

The  non-singularity  of  transformation  (4.27)  for  all  t  «  [t  fT]  and 

o 

M-  e  [0,p,  ]  can  be  seen  from  the  determinant  of  the  coefficient  matrix  of 
(4.28) 
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det 


W11  W12 
W21  W22 


I 

I 

1 

I 

nl 

nl 

.  det 

n2 

n2 

+  OQa) 

(4.30) 

P11 

N11 

P22 

N22 

f  0  since  the  bracketed  terms  of  (4.30)  are  non-zero. 


The  following  lemma  shows  that  transformation  (4.28)  transforms 
(4.6)  into  two  decoupled  systems;  one  containing  & ^  and  and  the  other  con¬ 

taining  ^  and  r2-  The  transformation  also  results  in  the  l  boundary  layer 
system  being  stable  in  forward  time  and  that  of  the  r  boundary  layer  system 
being  stable  in  reverse  time.  Thus  transformation  (4.28)  dichotomizes  the 
x2>  boundary  layer  system  as  the  transformation  of  Chapter  3  did  for  the 
original  system. 

Lemma  4.4.1  Let  the  conditions  of  Lemmas  4.3.1  and  4.3.2  be  satisfied. 
Then  the  non-singular  transformation  (4.27)  transforms  system  (4.5)  into 


*1 

1  * 

***  . 
K) 

1 _ 

3 

r  r  1 

1 

_U"2_ 

s 

All'SllPll'S12P12 

A12_M,S11P12'S12P22 

A2l‘S12Pll'S22P12 

A22’^S12P12“S22P22 

All‘SllNll"S12N12 

A12’M,S11N12"S12N22 

_A2L_S12NU*S22N12 

A22*uS12N12'S22N22 

(4.31) 


(4.32) 


or  in  more  compact  notation 


(4.33) 


(4.34) 


where  the  definition  of  is  evident  from  comparison  of  (4.33)  with  (4.31) 
and  that  of  G.  from  comparison  of  (4.34)  with  (4.32). 

**  J 

Proof :  Upon  elimination  of  z^,z 2  from  (4.6)  using  (4.28)  and  comparing 
this  result  with  what  it  must  be  to  satisfy  (4.31)  and  (4.32),  it  suffices 
to  show  that 


— 1 

»-* 

►-* 

t— 

to 

_ 1 

D11 

°12 

1  CM 

H 

» 

H 

3 

1 _ 

»— 4 

a 

L _ . 

'*11 

E12_ 

[_y.W21  ^22. 

_°21 

d22_ 

w  w 

L  21  22J 

fW21 

W22  _ 

-E21 

E22. 

where 


'Fu 

0 

F12 

0 

Eil  * 

0 

Gll. 

*  E12  " 

0 

GU. 

"F21 

0 

F22 

0 

E2l  “ 

0 

G21. 

*  E22  “ 

0 

G22- 

(4.35) 


(4.36) 


It  can  be  readily  shown  that  (4.35)  is  satisfied  as  an  identity. 
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4,5  Proof  of  Main  Theorem 

The  systems (4.31)  and  (4.32)  are  convenient  for  a  straight  forward 

proof  of  the  theorem.  It  will  first  be  assumed  that  initial  conditions 

Aj°Qj.),  are  given  at  t  ■  t  for  system  (4.31)  and  final  conditions 

T  T 

r^  (n),  r 2  (p.)  are  given  at  t  *  T  for  system  (4.32).  These  boundary  conditions 
are  assumed  to  be  twice  continuously  differentiable,  Thus  two  independent  singu¬ 
larly  perturbed  initial  value  problems  exist,  and  Theorem  A. 5  cap  be  applied  pro¬ 
viding  its  assumptions  are  satisfied  since  P  and  are  twice  continuous  dif¬ 
ferentiable  functions  for  all  t  6  [tQ,T]  and  for  all  p,e[0,n*]  in  view. of  Lemmas 
4. 3.1. and. 4. 3. 2.  Also  the  boundary  layer  parts. of  4.3.1  and  4.3.2  are  stable  in 

their  respective  time  directions  since  [a22_S22^22^  and  "^22*^22^22^  are 
stable  matrices  by  Lemmas  4.3.1  and  4.3.2  respectively.  Thus  when  £j°,  i<2 
are  given.  Theorem  A. 5  permits  one  to  write  for  (4.33) 


i1-I1  +  O0i),  i2  -  l2  +*2(t)  +  OGO 


(4.37) 


where  the  reduced  solution  satisfies 


K  =  ^11  "  ^12^22  *21^*1 


(4.38) 


and  the  initial  condition 


*1  “  *i°  at  t  "  t0’ 


(4.39) 


and  where  i2  is  algebraically  related  to  by 


J  m  f 

2  22  r21  1 


(4.40) 


mum 


Also,  the  left  layer  solution  satisfies 


dr  “  ^22(to^  "  ^22^0^22^0^  Z2 


(4.41) 


and  the  Initial  condition 


X2  "  l2  ~  VV  at  T  "  0 


(4.42) 


Similarly,  Theorem  A. 5  permits  one  to  write  for  (4.34) 


rl  “  ^i  +  0(p,),  r2  -  r2  +  f?2(o)  +  Ofti) 


(4.43) 


where  the  reduced  solution  r^  satisfies 


;1  '  C5U  '  *1 


(4.44) 


and  the  end  condition 


"  *1  at  t  -  T, 


(4.45) 


where  r2  is  algebraically  related  to  r^  by 


f2  '  •a22'l521fl 


(4.46) 


Also,  the  right  layer  solution  satisfies 


-  [a22(t)  -  s22(t)n22(t)]  R2 


(4.47) 
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and  the  end  condition 

f?2  =  r2T  -  r2(T)  at  a  -  0  .  (4.48) 

o  o  'X' 

Thus  far  it  has  been  assumed  that  the  boundary  conditions  l ^  »  ^2  *  rl  * 
and  have  been  given.  What  now  must  be  shown  is  how  to  find  these 
boundary  conditions  i*t  1°,  ^T,  and  in  terms  of  the  boundary  con¬ 
ditions  X  °,  x  °,  xj,  3i  .  x2T  specified  in  (4.3)  to  satisfy  the  theorem. 
Using  the  transformation  in  (4.27) 

xL(t,n)  -  Ix( t)  +  C^1(t,M.)  -  I1(t)D  +  rx(t)  +  Cr1(t.M.)-r1(t)3 
x2(t,n)  *  Z2(t)  +X2(t)  +  [Je2(t,ii)  -  i2(t)  -  X2(t)]  (4.49) 

+  ?2(t)  +  ^2(a)  +  [r2(t,li)-r2(t)  -  /?2(a)] 

is  satisfied  as  an  identity  for  all  t  e  [to,T]  and  for  ail  p.  c  [0,y.  ].  By 
selecting  boundary  conditions  in  accordance  with  (4.39),  (4.42),  (4.45), 
and  (4.48)  as  required  by  Theorem  A. 5,  (4.49)  becomes 

x^t.n)  =  [I  (t)  +  rt(t)]  +  0(n) 

(4.50) 

x2(t,u)  -  C£2(t)  +  r2(t)]  +X2(t>  +^2(a)  +  0(h) 

By  H  4.1.4,  there  exists  a  unique  reduced  solution  x^,  X^  of  system  (4.7) 
satisfying  the  x  ° boundary  conditions  and  it  is  uniquely  related  to 
y  X2  m  (4.8)  by  H  4.1.3.  Recall  the  non-singular  W(t,u)  transformation 
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in  (4.28)  is  defined  for  p,  =  0.  Thus  solving  the  reduced  x^,  system 
(4.7),  (4.8)  is  equivalent  to  solving  the  reduced  I^,r^  systems  (4.38), 
(4.44)  providing  the  boundary  condition  requirements  are  met  which  are  readily 
seen  from  (4.28)  for  ^  =  0  to  be 

il<to>  +  *1^0*  =  X1°*  £j_(T)  +  r1(T)  ■=  xxT  (4.51) 

o  X  o 

Thus  the  existence  of  ,  and  r^  is  assured  by  letting  i .  *  Zj,(tQ)  and 

_  t 

r^  =  r^(T)  and  x^  and  x^  can  be  expressed  by 

xL(t)  =  £1(t)  +  r^t),  x2(t)  =  I2(t)  +  r2(t)  (4.52) 

Since  /^(o)  -*  0  as  ct  -•  -°°,  this  term  is  negligible  when  evaluating  (4.50)  at 
t  =  t  for  small  |i.  Thus  for  ^  =  0,  (4.50)  gives 

X2(0)  =  x2°  -  J2(to)  *=  [x2°  -  r2(to)]  -  A2(to)  (4.53) 

Hence  i2°  exists  and  is  equal  to  x 2°  -  r2(tQ)  upon  comparison  with  (4.42). 
Similarly,  since  I2(t)  -»  0  as  t  -»  ®,  this  term  is  negligible  when  evaluating 
(4.50)  at  t  =  T  for  small  p,.  Thus  for  =  0,  (4.50)  gives 

*2(0)  =  x2T  -  x2(T)  =  [x2T  -  £2(T)]  -  r2(T)  (4.54) 

-  T  -  t 

Hence  r 2  exists  since  X2(T)  exists  and  is  equal  to  x2  -  i2(T)  upon  comparison 

with  (4.48).  Thus  it  has  been  established  that 


1 

2 
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(4.55) 

d 

The  same  argument  used  to  establish  (4.52)  holds  for  proving  »* 

Xl(t)  =  P11l1  +  N11r1 

(4.56) 

X2(t)  =  P1^1  +  S12*i  +  ^22^2  +  S22r2 
Using  transformation  (4.28) 

•  i 

Xx(t,n)  =  [Pn+0(n)]Cl1-K)(^)]  +  [Nn-KKli)][?1-K)(li)] 

+  ti[P12-K)(n.)][£2+£2(T)  +0(n)] 

+  ti^i2+0^i)  ^r2+^2^  +  O0a)J 
=  [P-^f  +  0W 

=  Xx  +  0(n)  (4.57) 

X2(t,n)  «  [P^-W^KIj-HHp)]  +  [N^-KX^U^-KXn)] 

+  [P22+0Ci)][i2+£2(T)  +0(n)] 

+  [N22+0(m,)  ][r2-^2(o)  +  0  (jj.)  ] 

-  tP1^1+N1^1+P22i2-rt522?2]  +  ?22£2(T)-Hi22t2(ff)  +  0(n) 

-  X2(t)  +  P22(t)X2(T)  +  N22(t)^(<j)  +  0(p,) 

*  x2(t)  +  P22(to)X2(r)  +  N22(T)tf2(a)  +  0(n) 


xx(t,n)  =  xx(t)  +  0(n) 

x2(t,|j,)  =  x2(t)  +  £2(t)  +  ^(o)  +  0(ti) 


(4.58) 
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The  lest  step  is  justified  by  the  continuity  hypothesis  H  4.1.2. 

4.6  Control  end  Performance  Index  Approxlaat Ion 

Two  corollaries  will  be  proven  In  this  section.  The  first  establishes 
the  existence  of  an  approximate  control  solution  for  the  optimal  control  prob¬ 
lem  (4.1)  -  (4.3),  and  the  second  establishes  the  existence  of  an  approximate 
performance  index  for  this  problem. 

Corollary  4.6.1  Let  the  hypotheses  of  Theorem  4.2.1  be  satisfied.  Then 
there  exists  a  positive  constant  4*  >  0  such  that  for  ^  and  t  g  [tQ,T], 

u(t,n)  =  G(t)  +  Ul(t)  +URfe)  +  0<n)  (4.59) 

where 

G(t)  -  -r^tUB^OX^t)  +  B'(t)X2(t)] 

Ul(t)  -  -r1(t0)B*(t0)f22(t0)X2<T)  (4.60) 

UR(a)  -  -r1(T)B^(T)fi22(T)^2(a) 

Proof:  Recall  from  (4.4)  that  the  control  u  is  written  as 

u  -  -R'1(B»Xl  +  BJX2)  (4.61) 

Using  the  expansion  for  X^  and  X2  given  in  Theorem  4.2.1 

u  -  -R*l(B'CXl  +  0fc)3 

+  B’[x2+#22(to)x2(T)  +822(D^2(o)  +0(n))) 


(4.62) 
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But  from  H  4.1.2,  (4.62)  can  be  written  as 

u  =  -  R'1B'2P22(to)I2(T) 

-R"1B^N22(T)^2(a)  +  0  (jjl) 

or 

u  =  u  -  R  (t0)B2^to^22^to^£2<-T^ 

-  R_1(T)B^(T)N22(T)^2(ct)  +  0(u) 


(4.63) 


(4.64) 


Note  from  the  corollary  that  the  approximate  control  solution  is 

composed  of  three  control  vectors:  u(t) ,  U  (t),  and  U  (o) .  The  U  (t)  control 

Li  K  L 

is  the  stabilizing  control  for  the  boundary  layer  system 

«2  . 

—  -  A22(tc>>i2  +  B2(,o)u  <*•«> 

and  is  responsible  for  steering  the  system 


*l’ 

A11 

V 

y.x2 

_^21 

A22_ 

(4.66) 


from  its  initial  state  rapidly  to  its  reduced  state  while  optimizing  the 
performance  index  J.  The  reduced  u(t)  control  retains  the  system  solution 
near  its  reduced  solution  while  minimizing  J  until  close  to  t  =  T.  The 
Up(a)  control  results  in  the  boundary  layer  system 
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d*>  _ 

*p  -  A22(T)^,2  +  B2(T)u  <4-67) 


being  completely  instable  (no  state  stable)  and  is  responsible  for  steering 
(4.66)  from  its  reduced  state  near  t  *  T  rapidly  to  its  final  state  while 
minimizing  J. 

Corollary  4.6,2  Let  the  hypotheses  of  Theorem  4.2.1  be  satisfied.  Then 
there  exists  a  positive  constant  h*  >  0  such  that  for  pi  £  h*  and  t  c  [t^.T], 


J(h)  -  J  +  0(n)  (4.68) 

where 


i 


Proof :  From  (4.2), 

T 

J  -  j  J  (xjQj^  +  2xJQ12x2  +  X2Q22X2  +  u'Ru^dt  (4.69) 

*"0 

Using  the  asymptotic  expressions  for  x^,  x^ ,  and  u  and  H  4,1.2, 

J  -  3  +  [T[a{(t)X2(T)  +  a2 (c)^2 ^ 

Co 

T 

+  J  U^(T)A1(t)X2(T)  +  ^(o)A2(t)^2(cr)]dt 
co 

T 

+  J*  l£(T)A3(t)tf2(CT)  dt  +  0(h) 

Co 


(4.70) 
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whose  a^  vectors  (i  =  1,2)  and  matrix  coefficients  (i  =  1,3)  are  continuous. 
Recognizing  that  the  norms  of  £2(T)  anc*  ^2^  are  bounded  by 

-Cf(t-t  )/y,  a(t-T)  /jj, 

|l2(T)|<Ke  °  ,  |fc,(a)|*Ke  (4.71) 

for  some  positive  constants  K  and  a,  it  is  readily  seen  that  the  norm  of  the 
integral  terms  of  (4.70)  are  bounded  by  0(p,).  Thus  (4.70)  can  be  written 
as  (4.68). 

4.7  Discussion  and  Interpretation 

Theorem  4.2.1  gives  an  approximate  solution  for  (4.3),  (4.5)  and 
proves  it  is  asymptotically  valid  uniformly  for  t  e  [t  ,T].  The  essence  of 
the  proof  was  to  transform  the  singularly  perturbed  TPBV  problem  by  a  non¬ 
singular  transformation  into  two  singularly  perturbed  initial  value  problems 
which  would  satisfy  the  hypotheses  of  theorems  for  such  systems.  To  comply 
with  a  continuit  j  hypothesis  of  Theorem  A. 5 ,  the  boundary  conditions  for  two 
singularly  perturbed  initial-value  Riccati  system?,  whose  Riccati  gains  com¬ 
posed  the  transformation,  were  appropriately  selecced.  The  non-singularity  of 
the  transformation  was  a  consequence  of  its  determinant  being  asymptotically 
represented  by  the  product  of  terms  involving  the  determinant  of  the  difference 
of  symmetrical  positive  definite  Riccati  matrices  and  symmetrical  negative 
definite  Riccati  matrices.  Upon  approximating  the  solutions  of  the  trans¬ 
formed  singularly  perturbed  systems  involving  £  and  r  variables  respectively 
by  their  zero-order  asymptotic  expansions^,  and  by  appropriately  selecting  the 

- 


See  Appendix  for  definition. 
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j t  and  r  boundary  conditions,  the  summation  of  these  terms  yielded  the  and 
asymptotic  approximations  given  in  the  theorem.  Here  use  was  made  of  the 
relation  between  x^,  an<*  reduced  i  and  r  terms  expressed  by  the 
transformation. 

The  left  boundary  variable  satisfying  (4.13)  and  the  associated 
boundary  condition,  is  the  t  term  of  the  zero-order  asymptotic  approximation 
of  1 2»  It  can  be  seen  as  the  solution  of  the  following  optimal  regulator 
problem 

mtn  A y'y  +  G'R(to)u]dT  (4.72) 


subject  to  the  constraint 


dI2  -  - 

dT  *  k22('t<?Z2  +  B2^o^u  * 

(4.73) 

X2  =  x2°  "  *2^0*  at  T  *  0 


and  observed  through 


y 


-  a2(to,X2  • 


(4.74) 


The  solution  exists  and  the  coefficient  matrix  ^22(tC))"^22^to^B22^to^ 

is  a  stable  matrix;  thus  £2  “•  0  as  t  -*’*>.  Similarly  is  se®n  to  satisfy 

the  optimal  regulator  problem 


min  pO 


[y'jrt-u'R(T)u]do 


-00 


U 


(4.75) 
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subject  to  constraint 


dBT  ■  *22<w2  +  52(t)s- 

=  x2T  -  x(T)  at  a  =  0 


and  observed  through 


(4.76) 


y  =  C2(T)^2  .  (4.77) 

Similar  to  X2  ,  -[A22(T)-§22(T)N22(T) ]  is  a  stable  matrix,  and  ^(a)  -*  0  and 
a  -•  -®,  Thus  the  solution  of  x2  for  example  is  approximated  by  the  sum  of: 
the  reduced  solution  x2>  the  solution  of  a  left  layer  regulator  problem 
£2(t),  and  the  solution  of  a  right  layer  regulator  problem  R^ip) .  Corollary 
4.6.1  shows  that  the  optimal  control  u  is  also  the  sum  of  three  different 
controls--each  of  which  is  computed  independently  of  the  others.  The  theorem 
permits  an  engineer  to  approximate  the  solution  on  any  open  interval  by  using 
only  the  reduced  solution  and  can  add  either  a  left,  right,  or  both  left  and 
right  correction  terms  depending  on  his  application 

Since  X^t)  ->  0  as  r  -*  <*>  and  ^(o)  "  0  as  a  "  •*,  it  can  readily  be 
seen  when  expressing  t  and  a  as  functions  of  time  that  a  fast  transient  occurs 
at  t  *  tfl  from  X2  decaying  with  increasing  time  and  that  a  fast  transient 
occurs  at  t  =  T  from  R^  decaying  with  decreasing  time.  The  time  constants 
for  the  decay  are  directly  proportional  to  u ,  Therefore  the  presence  of  X2> 

R 2  in  the  state  and  control  variables  demonstrates  the  two-time  scale 


separation  properties. 
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It  is  further  noted  that  even  though  the  approximate  performance 
index  may  be  close  to  the  optimal  one,  this  in  no  way  Infers  that  the 
approximating  solutions  for  the  state  and  control  vectors  are  close  to  the 
actual  in  the  boundary  layer.  This  is  true  since  the  integral  value  from  a 
boundary  layer  term  is  negligible  for  p,  small  enough. 

The  existence  of  a  solution  to  (4.5)  satisfying  boundary  conditions 
(4.3)  could  have  been  shown  using  fundamental  matrices  in  a  manner  analogous 
to  (3.44).  This  method  would  show  that  ^2°’  riT>  ant*  r2T  are  un^ue^y 

determined  from  x]°>  x2°»  xj^>  and  x2^*  ^  useful  reference  for  proving  the 

existence  of  the  non-singular ly  perturbed  linear  TFBV  problems  of  the  type 
considered  is  found  in  [3]. 
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5.  FIXED  END-POINT  PROBLEM:  EXAMPLES 


5.1  Design  Example 

The  example  problem  worked  here  illustrates  the  important  points 
stressed  in  Chapter  4:  two-time  scale  property,  boundary  layers  at  both  ends 
of  the  time  interval,  closeness  of  the  approximate  solution  to  the  actual 
optimal,  stiffness,  and  how  the  interval  in  which  the  reduced  solution  may  be 
a  good  approximation  can  be  extended  by  decreasing  p. .  Graphs  are  given  which 
clearly  show  these.  The  graphs  not  only  compare  the  approximating  and  actual 
solutions  which  shows  the  closeness  of  the  approximation,  but  also  compare 
the  actual  and  reduced  solutions  which  shows  the  need  to  include  boundary 
layer  terms.  The  selection  of  a  time -invariant  problem  resulted  in  being 
able  to  actually  show  how  the  system  eigenvalues  approach  those  of  the 
reduced  and  boundary  layer  systems  as  ^  approaches  zero. 

The  optimal  control  problem  is  to  minimize  with  respect  to  the 
control  u  *he  performance  index 


J  -  f  (2x  2  +  x22  +  u2)dt 
0 


for  the  singularly  perturbed  system 


X1  ~  2  X2 


^x2  =  '  2  X1  +  2  X2  '  u 


(5.1) 


(5.2) 


whose  boundary  constraints  are  given  by 
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x^  =  Xj°  at  t  *  0  and  x^  *  at  t  »  T  (5.3a) 

X2  =  x-2°  at  t  *  0  and  X2  =  X2^  at  t  *  T  (5.3b) 

From  (4.6),  it  is  seen  that  the  necessary  conditions  for  an  extremal  are 
given  by 


(5.4) 


subject  to  (5.3).  From  (4.7)  and  (4.8),  the  reduced  x^,  X^  solution  is  to 
satisfy  system 


(5.5) 


and  boundary  condition  (5.3a).  Variables  X2 ,  X2  are  related  to  x^,  Xj  by 


where  the  inverse  can  easily  be  seen  to  exist. 
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It  will  first  be  shown  that  the  hypotheses  of  Theorem  4.2.1  are 
satisfied.  Upon  comparison  of  (4.6)  and  (5.4)  it  is  seen  that 


=  0  ,  R  =  1  ,  A22  =  1/2,  B2  =  -1,  and  C2  =  Jl 


1 

1 

1 


u 


•4 


Thus  H  4.1.1  is  satisfied  since  both  Q  and  R  are  positive  definite.  The 

continuity  assumptions  of  H  4.1.2  are  certainly  satisfied  since  this  is  a 

|  _  1  _ 

time -invariant  problem.  The  rank  of  ^2\^22^22^  and  [c^  is  one 

guaranteeing  that  H  4.1.3  is  met.  To  satisfy  H  4.1.4  it  must  be  shown  there 
exists  a  unique  reduced  solution.  Rewriting  (5.5)  and  (5.6), 


(5.7) 


(5.8) 


Explicitly  solving  (5.7),  (5.8),  and  (5.3a),  one  obtains 

-it  it 
2  .  2  . 

X1  =  0l<a2e  +  °3e  ) 

-  it  it 

>-L  *  «1(3a2e  2  -  2  0f3e  2  ) 

-  5  -  it  it 

X2  =  3  al(‘~a2e  2  +  *3e  2  * 

1  -  it  it 

>.2  =  -  3  0^(7  of2e  2  +  2  o3e  2  ) 


(5.9) 
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where 

dfj  =  l/(e  2  T  -  e  2  T) ,  c*2  -  e  2  T  Xj0  -  Xj1 

ot^  =  -  e  2  Xj°  +  XlT 


(5.10) 


Thus  all  the  hypotheses  are  satisfied.  The  boundary  layer  correction  terms 
will  now  be  found.  The  Riccati  equation  (4.16)  to  which  the  unique  algebraic 
synmetrical  positive  and  negative  definite  roots  are  to  be  found  is 


z2 


-  K 


22 


+  2 


(5.11) 


The  positive  root  P22(0)  an<*  ne8at:*-ve  root  N22(T)  are 

P22(0)  -  2  and  N22(T)  -  -  1  (5.12) 

Using  (4.14)  and  (4.15),  the  boundary  layer  correction  terms  £ 2  and  are 
given  by 

d£  - 

&T  =  "  1  X2’  X2  “  x2°  '  *2(0)  at  T  *  0  (5.13) 

cV? 

*  \  *2,  *2  -  *2T  -  x2(T)  at  a  -  0  (5.14) 


Thus 
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-  2 

I2(t)  =  tx2°  -  x2(0)]  e  2  T  ,  T  =  t/p, 
t  2  CT 

*2<o)  =  [x^  -  x2(T)1  e  2  y  ,  C  =  (t-T)/p 
where  from  (5-9), 

x2(0)  —  Q^(  ”®2 

x2(T)  =  |  aL(  -a2e"  2  T  +  a3  e  2  T) 

Using  (5.9),  (5.12),  and  (5.15) 

xt(t,n)  =  x3  +  0(p) 

x2(t,y.)  =  x2  +  £2(t)  +  R2{C)  +  0(p) 

X1(t,M.)  =  ^  +  0(p) 

X  2  ( t  ,m.  )  =  \2  +  P22(0)£2(t)  +  N22(T)^2(a)  +  0(p) 

Also,  from  (4.54),  u  =  X^  for  the  problem  and 
u ( t  ,M> )  -  u  +  2£2(t)  -  R2(o)  +  0(p) 

A  comparison  of  the  actual  solution  with  the  reduced  and 
order  approximation  will  be  done  for  the  specific  case  when 

x^°  =  4.0,  x2°  =  3.0,  xlT  =  0.5,  and  x2^  *  -1.3 


(5.15a) 

(5.15b) 

(5.16) 


(5.17) 

(5.18) 

zero- 

(5.19) 
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Figures  5.1  and  5.2  show  this  comparison  for  p,  =  0.1.  Although  the  approxi¬ 
mating  solutions  for  x^  and  X2  are  reasonably  close  to  their  actual  solutions, 
the  difference  is  expectable  since  the  value  of  p.  is  only  a  fifth  of  the  value 
of  the  smallest  coefficient  in  the  system  description.  The  transients  in 
the  boundary  layers  shown  in  Figure  5.2  are  evident  but  are  not  exceptionally 
steep.  Figures  5.3  and  5.4  show  the  same  comparison  for  p,  *  0.01.  Here  the 
difference  is  almost  negligible  on  the  scales  shown  and  the  transients  shown 
in  Figure  5.4  are  much  steeper  than  in  Figure  5.2. 

5.2  Eigenvalue  Discussion 

In  the  simple  problem  it  is  possible  to  explicitly  show  the 
dependence  of  the  eigenvalues  on  p,.  It  can  be  easily  shown  that  the  eigen¬ 
values  y  of  (5.4)  are  determined  from  the  expression 

16p.V+  +  36(2j  -  l)y2  +  9(25)  =  0  (5.20) 

and  given  by 

Y  =  ±| ~J  |(l-2^+/l-%  -  ^|  ^)  (5.21) 

An  analysis  of  these  eigenvalues  will  now  be  done  as  is  common  in  the 
design  of  stable  feedback  systems.  In  the  latter  case,  one  is  often  con¬ 
cerned  with  how  large  a  feedback  constant  must  be  to  stabilize  a  system. 

Root  locus  techniques  can  be  employed  to  accomplish  this.  Meerov  [37] 
applied  this  technique  to  analyze  the  stability  of  a  multiloop  feedback 
structure,  each  loop  containing  a  feedback  gain  expressible  as  a  constant 
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coefficient  times  the  variable  gain  coefficient  K.  By  letting  p,  =  1/K,  he 
developed  theorems  guaranteeing  the  existence  of  a  positive  constant  p,*  such 
that  for  (j ,Sp*  all  the  eigenvalues  of  the  system  considered  were  stable.  The 
hypotheses  of  his  theorems  were  based  on  showing  the  stability  of  simpler 
auxiliary  systems--one  such  hypothesis  was  to  show  the  stability  of  a  reduced 
equation  formed  by  setting  p,  =  0  in  the  characteristic  equation.  Thus  his 
theory  is  similar  to  that  employed  in  singular  perturbation  theory.  By 
writing  (5.20)  in  the  form 


9(-4y  +25) 


1 


(5.22) 


it  is  easy  to  see  that  the  eigenvalues  for  p,  =  0  correspond  to  those  of  the 
poles  of  (5.22).  This  is  termed  the  reduced  solution  and  is  most  easily 
obtained  by  setting  p,  =  0  in  (5.20).  The  other  values  can  be  found  by  con¬ 
sideration  of 


9(8P  +25p  ) 

2  2 
4(4P  -9)P 


(5.23) 


where  P  =  y/p,  in  (5.20),  These  eigenvalues,  those  not  observed  by  looking  at 

the  poles  of  (5.22),  for  p,  =  0  correspond  to  the  poles  of  (5.23).  The  poles 

of  (5.22)  are  given  by  y  =  +  j  and  are  identical  to  the  eigenvalues  of  the 

3 

reduced  system  (5.7).  The  poles  of  (5.23)  are  given  by  P  =  +  ^  and  are 
identical  to  the  roots  of  the  auxiliary  system  (5.13)  and  (5.14).  In  (5.24), 
these  roots  +  y^,  +  y 2  are  shown  for  different  values  of  p, .  y^  is  scaled  by  p 
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M- 

M-Yj^ 

^2 

.188 

.83 

4.45 

.1 

1.31 

2.86 

.01 

1 

1.48 

1 

2.52 

1 

+ 

0.0 

1.50 

i 

2.50 

(5.24) 


From  (5.24)  it  is  noted  that  the  eigenvalues  for  p  =  0  are  very  close  to  those 
for  p  =  .01  but  not  so  close  for  p  =  .  i  and  certainly  not  for  p  =  .188  where 
double  roots  occur.  This  is  in  agreement  with  the  graphs  shown  in  Figures 
5.1  -  5.4. 

5.3  Numerical  Aspect 

Should  the  problem  be  very  stiff  (p  much  less  than  .01),  an  explicit 
solution  to  this  problem  becomes  very  difficult  and  a  special  technique  would 
have  to  be  determined  for  solving  this  problem.  A  straight  forward  way  to 
solve  this  time -invariant  problem  is  to  first  find  the  eigenvalues  and  then 
determine  the  coefficients  of  the  exponential  terms  describing  the  x^,  x^, 
/.j,  and  variables  to  match  the  boundary  conditions.  The  trouble  with  this 
method  is  in  matching  the  boundary  conditions.  For  the  example  problem,  let. 

YLt  Y2t  "V  -Y2t 

X  —  C  G  +  c  +  cnS  +  C.G 

11  2  3  4 


Then  one  must  find  the  solution  of 


I 
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— 

1 

— 

—  — 

o 

1 

1 

1 

C1 

X1 

2 

2 

2 

2 

o 

3*1 

3  y2 

3  Y1 

-  3  v2 

c2 

X2 

V 

v  T 
y2 

^1T 

”Y2T 

= 

T 

e 

e 

e 

e 

c3 

X1 

2  V 

2  Y2T 

2  ^1T 

2  "y2T 

T 

|_3*le 

3y26 

‘  3*le 

-  3Y2e 

_c4  _ 

_X2  - 

(5.25) 


for  p,  =  0.01,  (5.25)  becomes 


"7iooe 

+ 

01 

.  100E  +  01 

.  100E  +  01 

.  100E 

+  01 

-  - 

C1 

-  ■— > 

4.0 

.  990E 

+ 

02 

.  168E  +  01 

- .  990E  +  02 

» 

H- * 

05 

00 

w 

+  01 

c  „ 

/ 

3.0 

.  302E 

+ 

65 

.  125E  +  02 

. 321E  -  64 

.  800E 

t 

o 

H-* 

C3 

0.5 

.  299E 

+ 

67 

.  210E  +  02 

- . 328E  -  62 

--135E 

+  00 

_c4- 

(5.26) 


whose  solution  vector  c'  is  given  by 


- . 354E  -  66  . 147E  -  01  -.995E  -  01 


408E  +  01 


(5.27) 


It  can  easily  be  seen  that  overflow  or  underflow  will  occur  for  p  much  less 
than  0.01  from  (5.26),  (5.27)  respectively.  Thus  for  a  very  stiff  system,  it 
may  not  be  practical  to  solve  for  the  actual  solution.  Yet  the  approximation 
described  in  this  thesis  is  simple  to  find  and  will  be  very  close  to  the 
actual  solution  for  p,  sufficiently  small. 


4 
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Ftg.  5.3.  Fixed  End  Poin 


t  Problem 
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6.  TERMINAL  COST  PROBLEMS  AND  EXAMPLES 

6.1  Introduction  and  Statement  of  Problem 

This  chapter  analyzes  the  optimal  open  and  closed  loop  control  of 
the  same  singularly  perturbed  linear  system  (4.1)  as  in  Chapters  4  and  5  but 
with  free  end  point  and  with  a  terminal  cost  in  the  performance  index 


J 


1 

2 


x’nx  + 
T 


1 

2 


T 

'  (x'Qx  +  u ' Ru)dt 

t" 

o 


^  L I  (^  >  ^n12^ 

htt^Cm.)  M.n22(p,) 


(6.1) 


(6.2) 


where  tt  is  symmetrical  positive  semi-definite  and  its  rr„  matrix  elements  are  three 
times  continuously  differentiable  functions  of  p,.  The  two-time  scale  design 
procedure  presented  here  for  obtaining  an  expression  asymptotic  to  the  exact 
solution  is  similar  to  that  presented  in  Chapter  4.  After  the  asymptotic 
correctness  for  the  expression  has  been  shown,  it  will  be  shown  that  a 
similar  evpression  results  if  the  singularly  perturbed  Riccati  gains  are 
substituted  by  their  zero-order  terms  in  finding  the  optimal  solution  of 
the  system  The  closeness  of  the  approximate  open  and  closed  loop  solutions 
to  the  optimal  one  will  be  shown  graphically  for  an  example  problem.  The 
results  of  this  chapter  are  immediately  applicable  to  the  linear  tracking 
prob lem . 

The  boundary  conditions  for  the  necessary  optimality  equations  (4  5) 


are  given  by 


o  ,  o 

=  x^  and  x^  =  x^ 


"ll  “"12  X1 


M.X2  J  Utt1’  ^n22  J  LX2 


at  t  =  t 


at  t  =  T 


(6.3) 


and  those  for  the  reduced  system  (4.7)  are  given  by 


X1  =  X1 


at  t  =  t 


Xf  =  at  t  =  T  . 


(6.4) 


As  pointed  out  in  the  proof  of  Lemma  4.3.1,  under  the  hypotheses  of  the  lemma, 


X^  is  related  to  x^  for  all  t  e  [tQ>T]  by 


X1  =  P11X1 


(6.5) 


where  .  is  the  unique  symmetrical  Riccati  gain  satisfying  its  associated 
Riccati  equation  and  boundary  condition  determined  from  6.4,  Thus  the 
reduced  solution  x^,  Aj  of  this  problem  is  known  to  exist  and  H  4.1.4  is 
not  needed. 


6  2  Open  Loop  Solution 

Theorem  6.2.1  Let  H  4.1.1,  H  4.1.2,  and  H  4.1.3  be  satisfied  for 
problem  (4.1),  (6.1)  and  (6.2).  Then  there  exists  a  positive  constant  p,* 
such  that  for  all  u  £  u*  and  for  all  t  €  [t  ,TJ 


and  and  are  the  symmetrical  positive  and  negative  algebraic 


solutions  of 
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^22K22  +  K22^22  "  K22^22K22  +  ^22  0  (6.11) 

evaluated  at  t  and  T  respectively. 

Remark:  Only  the  differences  in  the  proof  compared  with  that  of 
Theorem  4.2.1  will  be  emphasized.  The  essential  difference  lies  in  the 
determination  of  the  boundary  condition. 

Proof :  The  proof  consists  in  showing  that  the  boundary  conditions 
£  ,  ri  ,  ^2  «  r2  f°r  (4.42)  and  (4.48)  can  be  found  in  terms  of  the  boundary 

conditions  (6.3)  to  satisfy  the  theorem.  From  transformation  (4.27)  and 
boundary  conditions  (6.3),  it  is  readily  seen  that  the  reduced  £,  r 
solutions  satisfy 


I,(to)  +  Jj(to)  =  Xj°  (6.12a) 

rj(T)  =  -[N11(T)-n11(T)]"1[P11(T)-^u(T)]£1(T)  (6.12b) 


Since  the  reduced  x^,  x^,  X ^ ,  X2  solution  exists  and  is  related  to  the  l  and 

r  solution  by  a  non-singular  transformation,  the  £  and  r  solution  exists 

•  o  “  T 

satisfying  (6.12).  Hence  there  exists  an  £^  and  r^  and, 


xi  =  h  +  ri*  xi  =  pli£i  +  Nnri 


x2  '  ~l2  +  r2 ’  h2  P12A 1  +  ^12^1  +  *22l2  +  ^22*2 


(6.13) 


The  existence  of  follows  from  an  argument  identical  to  that  in  Theorem 

-  T 

4.2.1  The  last  step  of  the  proof  is  to  show  the  existence  of  r^  . 


Using 
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(4.27)  and  (6.3), 

X2  -  +  N1'r1+P22£2^22r2  =  "l^l^l*  +  TT22U2+r2)  at  =  T  (6'14) 

Grouping  like  terms  and  using  the  approximating  £  and  r  expressions  (4.37) 
and  (4.43)  results  in 

(Pj£  -  n^H^-K)^))  +  (N^  -  n^H^-KJGi)) 

+  (P22"1^22^^2+,C2^T^+0^1^ 

+  <S22""22)(V*2(a)'K)k))|  =°  (6'15) 

It  -  T 

Since  -  0  as  t  -  the  X2(r)  term  is  negligible  when  evaluating  (6.15) 

at  r  -  T  for  sufficiently  small  p.  Thus  for  p  =  0,  (6.15)  becomes  upon  use 
of  <6, 13) 

P?( 0)  =  -[N22(T)-f22  rl[x2(T)-f 1^(T)x1(T)-n22(T)x2(T) ]  (6.16) 

-  T 

Kut  from  <4.48),  ^2*0)  =  r2  *  ^(T)  °r 

r/  =  ^2(0)  +  ?2(T)  (6.17) 

Here  /?2<0)  given  by  (6.16)  exists  since  t  x^,  and  x2  exist  and  is  related 

to  them  by  the  non-singular  matrix  LN22(T)  “  n22^^  ’  Likewise,  r2(T)  exists 

-  T 

a s  previously  stated.  Hence  r,  exists  and  a  a*  exists  satisfying  the  theorem. 
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Corollaries  identical  to  4.6.1  -  4.6.2  hold  providing  the  reduced 
solution  and  boundary  layer  terms  are  evaluated  in  accordance  with  the 
Theorem  and  the  performance  index  is  approximated  by 

J  =  j  +  0(p)  (6.18) 

where 


1 

I 

I 

I 


(6.19) 


6.3  Discussion 

The  following  observation  is  made  since  it  will  be  used  in  the 

subsequent  section.  Suppose  tt^  is  symmetrical  positive  definite.  Then  by 

_  -  T 

choosing  P ^  =  rr^  at  t  =  T,  r^(T)  in  (6.12b)  is  zero,  r^  =  0.  From  (4.44) 

and  (4.46),  this  is  seen  to  imply  r^(t)  =  0  and  r2(t)  =  0  for  all  t  e  [t^.Tj 

which  in  turn  implies  1 , °  =  Xj°  from  (6.12a).  Thus  from  the  non-singularity 

of  (4  27),  it  follows  that 


x  !  (t)  =  ijft). 


*2(t)  =  £  2 ( t ) 


(6.20) 


>  1  ( t )  =  P11(t)£Ift),  >2(t)  =  Pj2( t) £  J (t)+P72(L)£,(t ) 


-  -  O 

wbf re  i j  and  i ^  are  evaluated  from  (4.38)  and  (4.40)  with  =  x^  From 

(4.53)  it  is  seen  that  £?(0)  =  )  and  from  (6.16)  that  the  expression 

for  P.,<0)  there  remains  unchanged  and  is  given  by 
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f?2(0)  =  -[N22(T)-n22]'1[X2(T)-n1*(T)x1(T)-n22(T)x2(T)]  (6.21) 

Thus  the  role  of  the  r-system  Is  to  produce  the  boundary  layer  jump  at  t  ■  T 
if  one  exists.  For  the  special  case  when  there  is  no  slow  system  for  the 
terminal  cost  problem  (6.1)  and  (6.2),  it  can  be  seen  from  (4.8)  that  x2  *  0 
and  X2  *  0  since  x^  *  0  and  X^  =  0.  From  this  fact  it  is  seen  that 
£2(0)  =  0  and  no  zero-order  boundary  jump  occurs  at  t  =  T. 

6.4  Closed  Loop  Solution 

Theorem  6.4.1  Let  the  hypotheses  of  H  4.1.1,  H  4.1.2,  and  H  4.1.3  be 
satisfied,  let  17^  be  synmetrical  positive  definite,  and  let  K^j(t,n)  be  the 
solution  of  the  Riccati  system  (4.17)  satisfying  the  tt^  boundary  conditions 
from  (6.3).  Then  the  substitution  of  the  zero-order  Riccati  gains  for 
K ^ ( t  ,p, )  given  by  U^(t)  +  K^(a)  in  the  determination  of  the  state  and  co¬ 
state  variables  yields  an  approximate  solution  which  is  asymptotic  to  the 
correct  solution  x^(t,n),  x2(t,p,),  X^(t,p,)»  and  X2(t,n)  and  given  by  the 
difference  of  the  actual  solution  and  Ofp,), 

x1(t,p,)  =  x^t)  +•  0(p, ) 

x  (t.u)  =  x„(t)  +  X9(t)  +  +  0(h) 

(6.22) 

X  j  ( t  )  =  XL(t)  +  0(h) 

X2(t,u)  =  X2(t)  +  r’22(to)X2(T)  +  N22(T)/?2(a)  +  0(H) 

Variables  x^(t),  x2(t),  X^(t)  and  X2(t)  are  related  to  I  and  r  parameters 
as  in  (6,20).  Variable  X2(t)  is  the  solution  of 
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dr  =  ^22(to)  "  ^22(to)^22(to)^J:: 


(6.23) 


subject  to  initial  condition 


£2  =  x2  -  x2(tQ)  at  t  =  0 


and  % ^ (<7)  is  given  by 


*2(ff)  -  -[K22(T)+K22(CT)-N22(T)]  CK12(0)x1(T)-W22(0)x2(T)]  (6.24) 

Proof :  The  proof  is  based  on  first  finding  an  asymptotic  expression 
for  the  state  and  co-state  variables  using  the  equivalent  asymptotic 
expressions  for  the  K^(t,p,)  solutions  and  then  recognizing  that  these  same 
expressions  result  when  using  only  the  zero-order  terms  of  K^(t,^i). 

Let  the  actual  Riccati  gains  be  given  by  K^^t.p,)  ~  ^ ( t )+K ^ ^ (cj ) -K) ( (ju ) 

and  the  auxiliary  "positive"  and  "negative"  Riccati  gains  by 
P.  j(t,p,)  =  j(t)+0(|j,)  and  N^(t,)j,)  =  Njj(t)+0(|i)  respectively  where 

i,j  =  1,2.  Here  K^(a)  =  0  since  no  zero-order  boundary  layer  occurs  in 
this  variable  and  P_(t)  are  chosen  equal  to  K^(t)  for  i,j  =  1,2.  Now 
X.  and  X.  are  expressible  in  terms  of  x.  and  x7  by 


K11  uK12 


^^12  K2  2 


for  all  t  c  [ t^ ,t] 


(6.25) 


and  in  terms  of  l  ^ ,  i2,  r^,  and  r2  using  transformation  (4.27)  as 
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X 

X 


1 

2 


=  Pll*l 


~  P12*l 


+  Nllrl 


+  N12rl 


+  ^P12£2  +  ^N12r2 

+  P^i,  +  N22r2 


(6.26) 


Thus  It  follows  after  elimination  of  X^f  X2  using  (6.25),  (6.26)  and  (A. 27) 
and  then  grouping 


<KirPll>*l  +  (KirNll>rl  +  ^K12-P12>A2  +  ^K12'N12)r2  =  0 

(6.27) 

(K12‘P12)£1  +  (K12'N12)rl  +  (K22_P22U2  +  (K22'N22)r2  =  0 


Rewriting  (6.27)  using  the  expanded  forms  for  K^,  P^, 


and  N 


ij 


C0(^)ji1+[Ku-N11+0(n)]r1-HiCK12+0(>i)]i2-Hi[K12-«{12-N12+0(iJi)]r2  *  0 

[K12i-0(^)]i  1+[K1^1^-N1^+0(lA)]r1  (6.28) 

+  [K22+0(.>)]£2+{K22-»«22'N22+0(u,)]r2  =  0 


Solving  (b,28)  for  r^,  r2 


_(K22-hK22-N22)'1K1^  <^224^22','S22)"lK22 


]  \ 

V 

+  0(u)l 

_£2_ 

(6.29) 


Therefore 


r  L  =  OdO^+O^)^ 

r2  =  -(K22-«22-N22)'1(K1^1-H(22/,2)+0(p)i.1-H)(n)A2 


(6.30) 
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o  ,  o  ,  o 
*1  -*1  +  rl 


=  XL0  +  001)^°  +  0(^).e2°  by  (6.30) 


(6.32) 


thus  Ij°  =  x ^  (6.32)  evaluated  at  p,  =0.  Similarly  for  x2 


o  .  o  ,  o 
x2  ^2  +  r2 


=  i2°  f°r  M-  =  0  since  r2°  is  zero  from  (6.30) 


(6.33) 


upon  recognizing  the  K12  and  variables  are  negligible  at  t  “  t  . 


Therefore , 


-  x,,°  and  from  before,  =  x^° 


(6.34) 


Hence  the  existence  of  and  in  terras  of  Xj°  and  x2°  has  been  established. 
From  the  transformation 


Thus  if  and  I2°  can  be  found  in  terms  of  the  specified  boundary  conditions 
x  °  and  x2°,  then  and  l 2  can  be  approximated  by 


l1(t,n)  =  i1(t)+0(n)>  l2(t4»)  =  l2(t)+C2(T)+0(n)  (6.31) 


where  £2(t)  is  the  solution  of  (6.23)  satisfying  the  boundary  condition 

S-2  =  1°  -  i2(to^  =  ^2°  '  x2^o^  at  T  =  °*  0nce  ii(t»M')  and  are 

found,  r^(t,|±)  and  r2(t;p,)  are  known  from  (6.29).  The  x^°  boundary  conditions, 
related  through  the  transformation  (4.27),  is 
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x1(t^i)  =  t,n)  +  r^t.y.) 

=  I  (t)+0(|i)  using  (6.30) 

=  x^(t)-rO(|j,)  by  (6.20)  (6.35) 

x2(t,(j.)  =  i2(t,M,)  +  r2(t,ui) 

=  ^2+i2-(K22^22-N22)  (^22^  2^12^1^ 

-(K22-W22-N22)  1K22£2+0(p.)  using  (6.30) 

=  £2+X2-(K22-+K22-N22)'1(K22^24K12jei)+00i)  (6*36) 

The  latter  step  is  justified  after  observing  that  the  product  of  a  a  and  r 
function  are  negligible  for  small  enough  jj,  .  Using  H  4.1.2  and  replacing 
l2  by  x2,  x2(t,p,)  can  be  written  as 

x2(t,n)  =  x2(t)  +  X2(t)  +  R2{o)  +  00i)  (6.37) 


whe  re 


R2{0)  =  -CK22(T)-H(22(a)-N22(t)]'1[Kl2(cr)x1(T)+}(22(a)x2(T)]  (6.38) 


Knowing  (6.35)  and  (6.37),  from  (6.25),  (6.35)  and  (6.37) 
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=  K11(t,^)A1(t,p,)-HiK12(t,M.)x2(t,M,) 

-  [p^OGOKi^HMn)]  +  OOi) 

=  P11I1  +  0(|a)  =  X  (t)  +  OOi)  from  (6.20)  (6.39a) 

X2(t,n)  =  K12(t,y,)x1(t,|j,)  +  K22(t,M,)x2(t,pi) 

-  [K^-BC^+OOijlCii+OOi)] 

+  [k22-w22+0(h)][12+£2^2+0(h)] 

-  CK1^1+K22I2]-t{K12jei-W22l2]+[K22-W22][X2-h?2]  +  OOi) 

=  ^2'^224K22'^22]'?2+tK22J*22^£2'H?2^  +  0^> 

=  ^2^22^22^  2^  2^  2  +  °^> 

=  ^2+K22(to)£2(T)+N22(T)/e2(t7)  +  O0a)  (6.39b) 

Since  the  same  asymptotic  expressions  result  when  the  zero-order  terms  of 
^(t ,n )  are  used,  the  theorem  is  proved. 

If  Xj  and  X2  had  been  eliminated  from  (4.5)  using  (6.25),  the 
resulting  x^  and  x2  equations  would  generally  be  discontinuous  at  t  8  T 
for  p.  =  0.  By  using  the  l  and  r  systems  it  was  possible  to  treat  well 
behaved  functions.  The  l  system  contained  no  boundary  jumps  and  the  r 
variables  which  did  were  determined  algebraically  once  the  l  parameters 


were  found. 


The  optimal  control  problem  is  to  minimize  with  respect  to  the 


control  u  the  performance  index 


T 

J  =  \  x1(T)2  +J  (2Xl2  +  x22  +  u2)dt 


(6.40) 


for  the  singularly  perturbed  system 


X1  = 


|J.x, 


3 

2  X2 


3  a.  1 

2  X1  +  2  X2 


(6.41) 


-  u 


whose  boundary  constraint  is  given  by 


x^  *  Xj°  and  x0  =  x^3  at  t  =  tQ  (6.42) 

The  optimality  conditions  for  this  problem  are  identical  to  those  given  for 
the  problem  in  Chapter  5  except  for  the  boundary  constraints  which  are  now 

(6  .<*2 )  and 


X^D'x^T),  X2(T)  =  0  (6.43) 

The  solution  ,  X^  is  to  satisfy  the  reduced  system  (5-7)  and  the  x^ 
boundary  condition  of  (6.42)  and  the  X^  boundary  condition  of  (6.43).  The 
variables  x2>  X2  are  related  to  x^,  X^  by  (5.8).  .ince  the  hypotheses  of 


J 
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Theorem  6.2.1  are  Identical  to  those  of  Theorem  4.2.1,  the  hypotheses  are  met 
as  previously  established  in  Chapter  5.  The  reduced  solution  is  thus 
given  by 


r  -  l(t-T> ,  2  !<t-T>  -i  < 
a4  Le  +  3e  J  *1 


x2 


L3e  -  3  e  J  *1 

s  r  '  ^<t-T)  .  2  l(t'T)  i  < 

3  “4  l'*  +  3  e  J  *1 


(6.44) 


i  r  "  l(c'T)  4  f (t-T)  i  o 

l2--3»4L7‘  +  3  6  JX1 

-|l/(1+|e-5T, 

where  =  e  .  The  boundary  layer  correction  terms  are 

found  next.  Recall  P22(0)  =  ^  and  N22(T)  =  *roni  (5.12).  Thus  these 
correction  terms  are  given  as  the  solution  of 


dX?  - 

dT  =  ~  i  £2’  Z2  =  X2  '  *2(0)  at  T  =  0 


^2  3 

dJ  =  2  *2’  *2  =  X2(T)  at  °  =  0 


as  seen  from  (6.7)  -  (6.10)  where  from  (6.44), 


5  T  .5 

-  5  ,  2  1  ,  2  2  A. 

x2(0)  *  3  «4(-e  +  3  e  ) 


(6.45) 


*2(T) 


25 

9  a4xl 


o 


(6.46) 
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Thus  from  (6.45)  and  (6.46), 


.  1 

■C2CO  =  ^x2°  ‘  x2<0^  e  2 

3 

e  /  s  ,  25  o.  2 

£2(<*)  =  (  "  -9  «4*1  )  e 


(6.47) 


Hence  all  the  terms  composing  the  zero-order  approximate  solution  of  the 
variables  are  known--!. e.. 


xL(t4i)  =  xL(t)  +  0(n) 

x  (t.H)  =  x  (t)  +  X  (t)  +  £  (cr)  +  0(H) 

(6.48) 

^1(t,H)  m  Xt(t)  +  0(h) 

^ 2 ( t ,H )  -  ^2(t)  +  P22(0)X2(t)  +  N22(T)*2(o)  +  0(h) 

Also,  from  (A. 60),  u  =  X2  where  X2  is  given  In  (6.44)  and 

u  -  u  +  2X2(t)  -  £2(a)  +  0(h)  (6.49) 

To  compare  actual  solutions  with  zero-order  solutions,  the  follow¬ 
ing  boundary  conditions  were  selected. 

Xj°  *  4.0  and  x2°  ■  3.0  (6.50) 

Figures  (6.1)  -  (64)  show  this  comparison  for  h  *  0.1.  The  and  x2  plots, 
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Figure  (6.1)  and  Figure  (6.2),  are  similar  to  their  plots  shown  in  Figures 
(5.1)  and  (5.2)  respectively  due  to  the  special  selection  of  boundary 
cond it  ions. 

6.6  Closed  Loop  Design  Example 

From  (4.17)  and  (4.18)  for  the  free  end-point  problem  just  discussed, 
the  singularly  perturbed  Riccati  system  is  given  by 


II 

3K12  +  K12 

3  1 

^*12  = 

-  2  K11  -  2  K 

HK22 

3^Kj^  ”  K?2 

(6.51) 


subject  to  boundary  conditions 


K11  =  1»  K12  *  and  K22  =  0  at  t  “  T 


(6.52) 


and  the  reduced  solution  is  to  satisfy 


3K12  +  K22  -  4 


-  2  Kji  -  2  ^i2  +  2  *22  +  *12*22 


(6.53) 


-K22  +  K22  -  2 


and  the  boundary  condition 
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Ku  -  1  at  t  -  T. 


(6.54) 


The  reduced  solution  is  given  by 


9  -  4  e  5<C-T> 


3  -  8  e 


Kn  ’  3  +  2  .  5(t-X)  *  Ku  2  +  2  e  5<t'T) '  “22 


(6.55) 


The  Riccati  correction  terms  are  to  satisfy 


do 


1  K 

2  *12 


+  k2?(|  +  X 


12' 


(6.56) 


do 


K22(K22  +  3) 


(6.57) 


and  the  boundary  condition 


K12  =  "l2(T)**12(T)»  K22  *  "22(T)'*22(T)  at  CT  "  °* 


(6.58) 


But  from  (6.55),  K12  *=  -1  and  K22  ■  2  at  t  ■  T.  Thus  X12  *  1  and  X22  ■  -2 
at  t  =  T.  Hence 


X12(a) 


.1- 


1+2  e 


3o 


(5 


2  e  2  a) 


X22(a) 


6  e 


1+2  e 


30 


(6.59) 
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The  K^(t,n)  solutions  of  (6.51)  are  thus  approximated  by 


Ku(t4i)  =  Ku  +  0(n) 

K12(t,n)  =  K12  +  K12(a)  +  0(h)  (6.60) 

K22(t,n)  =  ic22  +  X22(a)  +  0(h) 

Figures  (6.5)  -  (6.7)  compare  the  actual  and  approximate  solutions  for  K^, 

K12,  and  K22  for  h  =0.1.  Figure  (6.8)  does  the  same  for  h  =  0.01.  The  two 
solutions  are  very  close  when  h  =  -01  and  the  transient  occurring  at  t  =  T 
is  becoming  quite  steep.  Figures  (6.1),  (6.2)  show  that  the  x^,  x^  approximate 
solutions  found  using  the  Riccati  approximations  are  very  close  to  the 
correct  values.  Figures  (6.3),  (6.4)  show  the  same  information  for  X ^ ,  X2 
computed  using  (6.25)  with  the  corresponding  approximate  expressions  for  the 
Riccati  gains  and  state  parameters.  The  fact  that  the  closeness  is  better 
than  in  the  open  loop  case  is  not  surprising  since  the  dorrection  terms 
were  computed  from  non-linear  systems  in  the  latter  case.  Thus  this  feed¬ 
back  example  supports  Theorem  6.4.1. 

To  emphasize  the  fact  that  u.  should  be  small  for  the  theorems  to 
hold,  recall  from  the  eigenvalue  analysis  that  h  =  1  should  be  completely 
unreasonable.  To  graphically  show  this,  the  plot  of  x2  is  shown  in 
Figure  (6.9).  Closeness  does  not  apply.’ 

Remark:  Recall  the  expression  given  for  ^2(a)  in  Theorem  6.4.1 

tf2(ff)  -  -[K22(T)+X22(o)-N22(T)j_l[Kl2(C)x1(T)+X22(o)x2(T)]  • 


(6.61) 
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It  will  be  shown,  for  tb°  problem  considered,  to  be  equivalent  to  the 
term  used  in  Theorem  6.2.1  given  by  (6.47). 


2-6 


1  3 

4cx  4cx  _  ^  Ja 

„  (5  -  2e  )  j  a4xi  3j. 

l+2eJC  J  *  1  l+Ze* 


Ov  _  ¥ 


5  o 
9*4*1 


“  <-  H  Vi°)e 


(6.62) 


Thus  the  equivalency  has  been  shown. 


3 


Fig.  6.2.  Free  End  Point  Problem 
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Fig.  6.3.  Free  End  Point  Problem. 
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Fig.  6.4.  Free  End  Point  Problem. 
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Fig.  6.5.  Free  End  Point  problem 


X2(t)+J r2(r)+<fc2(cr) 

X2(  t,  fj.)  Using  Zero 
Order  Ricatti 

J _ I _ ! _ ! _ I _ 

0.2  0.4  0.6 

Time 


Fig.  6,9.  Free  End  Point  Problem. 


APPENDIX  A:  INITIAL  VALUE  PROBLEM 


This  appendix  contains  an  initial  value  singular  perturbation  lemma 
and  theorem  for  the  non-linear  system 


*1  =  f  i(x1,x2,t,n)  ,  xL  =  p(n)  at  t  -  t 

=  3  x2  ‘  at  t  -  t 


(A  •  1/ 


where  x^,  x^  are  n^-,  n2 -dimensional  vectors  and  p  is  a  small  positive  scalar 
parameter.  The  lemma  establishes  that  the  boundary  layer  terms  of  the  solution 
of  (A. 1)  will  be  identically  zero  for  some  1].  The  theorem  establishes  that  the 
solution  of  (A.l)  can  be  approximated  uniformly  on  the  entire  interval  [tQ,T], 
Let  the  reduced  solution  x^,  x2  satisfy  the  system 

X1  =  f  i(xi»x2»t»0)  *  Xjl  *  P(0)  at  t  «  t 


0  =  f2(x1,x2,t,0) 


(A. 2) 


formed  from  (A.l)  by  setting  p  equal  to  zero.  The  following  hypotheses 
are  assumed. 


H  A . 1  System  (A. 2)  has  a  continuous  solution  x. ,  x„  for  all  t  «  [t  ,t] . 

1  *-  o 

H  A  -  2  The  functions  f^,  f2  have  continuous  derivatives  to  order  R  +  2 
with  respect  to  (Xj.x^t.p)  in  some  neighborhood  of  (x^x^t.O),  t  e  [t  ,T], 
p  *  [0,p*]  for  some  p*  >  0.  Also  p,  T)  have  continuous  derivatives  to 
order  R  +  2  with  respect  to  p  for  p  e  [0,p*]. 


5f2  -  - 

H  A . 3  The  real  parts  of  the  eigenvalues  of  - —  (x.,x-,t,0)  are  less 

o*2  ^  ^ 

than  a  fixed  negative  number  for  all  t  e  [t  ,T]. 


J 


no 


Lemma  A. A  Let  H  A.l  -  H  A  3  be  satisfied.  Then  there  exists  a  p,*,  or  >  0 
such  that  when  | p (jj. ) - x (. t J  <  a  and  n  e  [0,p,*],  a  solution  of 

-‘l  -  f1(x1>x2,t,M.),  x2  =  p(p.)  (A. 3) 

~  f  2  (x ^  , X2  ,  t  ,y, ) 


exists  which  satisfies 


r  R+ 1 

x  (t,p.)  =  E  xj^  ( t )jjl  +  0(p,  ) 

1  r=0  r 

®  r  R+l 

x  (t,u)  *  £  x,  (t)p,  +  OUji  ) 
1  r=>0  r 

for  all  t  e  [to,T],  p.  e  (0,p*J. 


(AM 


Theorem  A .5  Let  H  A.l  -  H  A. 3  be  satisfied  where  R  =  0  Then  there  exists 
a  p.*  >  0  such  that  for  all  p  :£  p,*,  all  the  solutions  x^  ( t  ,p)  ,  x2  (t  ,p)  of  (A.l) 
starting  in  some  neighborhood  of  the  reduced  solution  at  t  =  t  exist  on  the 
interval  [tQ,IJ  and  satisfy 


x^t.p)  -  xl(t)  +  0(p) 
x2(t,p)  -  x2(t)  +  A (t)  +  0(u> 

where  A(t)  is  the  solution  of 


27  -  f 2 (p (0)  ,  A+x2>to,0),  A  -  T)(0)  -  x2(tQ) 


(A  5) 


(A  6) 


and  A  ■*  0  as  t 


— •  00 


Ill 


The  x^  and  solutions  of  (A. 3)  and  their  R  +  1  derivatives  with 
respect  to  g,  are  continuous  and  equal  to  the  reduced  solution  at  g,  =0. 

From  (A. 6)  is  is  evident  that  the  x^  initial  condition  implied  for  problem  (A. 3) 
should  be  ^(t).  This  lemma  and  theorem  follow  from  a  much  more  general 
lemma  and  theorem  given  in  [21].  The  terms  x^(t)  and  x^(t)  +  A(t)  are 
called  the  "zero-order"  approximation  of  x^(t,g)  and  x^Ct.g.)  in  (A. 5). 
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